# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Disallow: /eng/ Disallow: /test/ Disallow: /newsletter/ Disallow: /OLD/ Disallow: /zip/ Disallow: /swf/ Disallow: /index_newsletter.htm Disallow: /newsletter_spillette.htm Disallow: /Copy of solite_domande.htm Disallow: /newsletter.htm