# /robots.txt file for http://www.specficworld.com/ Sitemap: http://www.specficworld.com/sitemap.txt User-agent: Mediapartners-Google* Disallow: User-agent: * Disallow: /images/ Disallow: /images_pubs/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /awstats/ Disallow: /App_Data/ Disallow: /App_Code/ Disallow: /App_Themes/ Disallow: /members/images/ User-agent: msnbot Crawl-delay: 120 Disallow: /images/ Disallow: /images_pubs/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /awstats/ Disallow: /App_Data/ Disallow: /App_Code/ Disallow: /App_Themes/ Disallow: /members/images/ User-agent: teoma Crawl-delay: 120 Disallow: /images/ Disallow: /images_pubs/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /awstats/ Disallow: /App_Data/ Disallow: /App_Code/ Disallow: /App_Themes/ Disallow: /members/images/ User-agent: slurp Crawl-delay: 120 Disallow: /images/ Disallow: /images_pubs/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /awstats/ Disallow: /App_Data/ Disallow: /App_Code/ Disallow: /App_Themes/ Disallow: /members/images/ User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: EroCrawler Disallow: / User-agent: ExtractorPro Disallow: /