Comments on: Volusion Robots.txt File http://www.schawel.com/volusion-robotstxt-file/2009/05/21/ Fri, 27 Aug 2010 18:35:16 +0000 hourly 1 http://wordpress.org/?v=3.0.1 By: schawel http://www.schawel.com/volusion-robotstxt-file/2009/05/21/comment-page-1/#comment-892 schawel Mon, 31 May 2010 08:42:19 +0000 http://www.schawel.com/?p=955#comment-892 Just declare this.. <code>Disallow: /ProductDetails.asp</code> You don't have to write anything after it. This tells bots to stop crawling this page and any parameters that are passed along with it. BTW - Why do you still have http://www.timelesswroughtiron.com/product-p/stratford-foyer-table-902561.htm You should have a link title in there. Don't use product-p. Read the Volusion manual for more info. Just declare this..

Disallow: /ProductDetails.asp

You don’t have to write anything after it. This tells bots to stop crawling this page and any parameters that are passed along with it.

BTW – Why do you still have http://www.timelesswroughtiron.com/product-p/stratford-foyer-table-902561.htm

You should have a link title in there. Don’t use product-p. Read the Volusion manual for more info.

]]> By: Ryan Hansen http://www.schawel.com/volusion-robotstxt-file/2009/05/21/comment-page-1/#comment-891 Ryan Hansen Sun, 30 May 2010 16:39:12 +0000 http://www.schawel.com/?p=955#comment-891 Thank you for this website and the great content. I recently moved my web store to Volusion for better SEO, during the first few days I was becoming skeptical but I'm now hopeful. I have an issue that I don't think is mentioned on here. My product have multiple tabs; description, technical specs, and extended info. Apparently each tab is considered a new page and Google has started to index them, consequently declaring duplicate Meta Info on all of my products. Is there a way to stop this from happening? Here is an example of product where Google has indexed the Product Tabs: 1. http://www.timelesswroughtiron.com/ProductDetails.asp?ProductCode=STRATFORD-FOYER-TABLE-902561&Show=ExtInfo 2. http://www.timelesswroughtiron.com/ProductDetails.asp?ProductCode=STRATFORD-FOYER-TABLE-902561&Show=TechSpecs 3. http://www.timelesswroughtiron.com/ProductDetails.asp?ProductCode=KNOT-SIDE-TABLE-900323 4. http://www.timelesswroughtiron.com/product-p/stratford-foyer-table-902561.htm (this is the proper product url) I would like to stop the indexing of all the “/productDetails.asp?ProductCode=” I’m assuming I would just enter “Disallow: /productDetails.asp?ProductCode=” in the robots.txt but I would like some confirmation/clarification. Thank you for this website and the great content. I recently moved my web store to Volusion for better SEO, during the first few days I was becoming skeptical but I’m now hopeful.
I have an issue that I don’t think is mentioned on here. My product have multiple tabs; description, technical specs, and extended info. Apparently each tab is considered a new page and Google has started to index them, consequently declaring duplicate Meta Info on all of my products. Is there a way to stop this from happening?
Here is an example of product where Google has indexed the Product Tabs:
1. http://www.timelesswroughtiron.com/ProductDetails.asp?ProductCode=STRATFORD-FOYER-TABLE-902561&Show=ExtInfo
2. http://www.timelesswroughtiron.com/ProductDetails.asp?ProductCode=STRATFORD-FOYER-TABLE-902561&Show=TechSpecs
3. http://www.timelesswroughtiron.com/ProductDetails.asp?ProductCode=KNOT-SIDE-TABLE-900323
4. http://www.timelesswroughtiron.com/product-p/stratford-foyer-table-902561.htm (this is the proper product url)
I would like to stop the indexing of all the “/productDetails.asp?ProductCode=” I’m assuming I would just enter “Disallow: /productDetails.asp?ProductCode=” in the robots.txt but I would like some confirmation/clarification.

]]> By: schawel http://www.schawel.com/volusion-robotstxt-file/2009/05/21/comment-page-1/#comment-837 schawel Tue, 04 May 2010 07:28:29 +0000 http://www.schawel.com/?p=955#comment-837 You could either (or both) explicity call out Googlebot instead of using the wildcard or you can use Google Webmaster Tools and remove that URL from the crawl. Let me know how that works for you. Resource: http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 You could either (or both) explicity call out Googlebot instead of using the wildcard or you can use Google Webmaster Tools and remove that URL from the crawl. Let me know how that works for you.

Resource: http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

]]>