# Robots.txt file by http://www.urbanhorizon.com # # All robots will spider the domain except the admin directories User-agent: * Disallow: /Templates/ Disallow: /Library/ Disallow: /Archive/ Disallow: /gfx_media/ Disallow: /admin/