# /robots.txt file for http://www.soulspider.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /blog Disallow: /proevideos# BEGIN XML-SITEMAP-PLUGIN Sitemap: http://www.soulspider.com/sitemap.xml.gz # END XML-SITEMAP-PLUGIN