# robots.txt to allow everything but admin to be spidered
User-agent: *
Disallow: /admin/