Comments on: Volusion Robots.txt File http://www.schawel.com/volusion-robotstxt-file/2009/05/21/ Mon, 09 Jan 2012 23:18:11 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Symbom Plush and Cloth Toys http://www.schawel.com/volusion-robotstxt-file/2009/05/21/comment-page-1/#comment-1152 Symbom Plush and Cloth Toys Fri, 12 Aug 2011 07:20:06 +0000 http://www.schawel.com/?p=955#comment-1152 Pretty nice article. I like it. Pretty nice article. I like it.

]]> By: John Deszell http://www.schawel.com/volusion-robotstxt-file/2009/05/21/comment-page-1/#comment-1061 John Deszell Thu, 09 Dec 2010 16:34:46 +0000 http://www.schawel.com/?p=955#comment-1061 Schawel, I did exactly what you suggested back on the 24th of November and I'm still seeing search results being indexed. Any other suggestions? Schawel,

I did exactly what you suggested back on the 24th of November and I’m still seeing search results being indexed.

Any other suggestions?

]]> By: schawel http://www.schawel.com/volusion-robotstxt-file/2009/05/21/comment-page-1/#comment-1059 schawel Wed, 24 Nov 2010 04:28:59 +0000 http://www.schawel.com/?p=955#comment-1059 Try to explicitly call out the bot. User-Agent: Googlebot Disallow: /SearchResults.asp <em>Please note that having a disallow in your robots.txt file does not 100% guarantee it will be heeded. For hard core control make a rule in the .htaccess file</em> Try to explicitly call out the bot.

User-Agent: Googlebot
Disallow: /SearchResults.asp

Please note that having a disallow in your robots.txt file does not 100% guarantee it will be heeded. For hard core control make a rule in the .htaccess file

]]>