# Robots.txt file created by http://www.webtoolcentral.com # For domain: http://www.tastycrockpotrecipes.net # All robots will spider the domain User-agent: * Disallow: /recipes1/printer/ Disallow: /recipes2/printer/ Disallow: /recipes3/printer/ Disallow: /recipes4/printer/ Disallow: /cgi-bin/ Disallow: /advertiser.html Disallow: /advertiser_cj.html Disallow: /bookrec1.html Disallow: /bookrec2.html Disallow: /bookrec3.html Disallow: /bookrec4.html Disallow: /bookrec5.html Disallow: /images/ Disallow: /setup/ Disallow: /admin/ Disallow: /docs/ Disallow: /phorum-3.4/ Disallow: /s2etup/ Disallow: User-agent: SlySearch Disallow: / User-agent: turnitinbot Disallow: / User-agent: FreeFind Disallow: /recipes1/printer/ Disallow: /recipes2/printer/ Disallow: /recipes3/printer/ Disallow: /recipes4/printer/ Disallow: /phorum-3.4/