View Single Post
  #6  
Old 09-20-2006, 10:32 AM
 
Jerrad Jerrad is offline
 

X-Adept
  
Join Date: Nov 2004
Location: The Netherlands
Posts: 484
 

Default Re: XC SEO Lite v1.0.0 Released

Thanks intel, that did it!
Mod works great now - thanks again!

I only have some questions abot the robots.txt...

My store is in the directory /shop
Should I change the text as below?

User-agent: *
Disallow: /shop/cgi-bin/
Disallow: /shop/*?
Disallow: /shop/catalog/
Disallow: /shop/search.php
Disallow: /shop/cart.php
etc. etc.

And will the User-agent: * do for all the bots or is it better to go sure and do
several 'disallow listings' for the major searchbots (like google and msn)?

And last question...
Is it possible with the robots.txt to stop search engines to visit the Printable & Sort urls ?

Thanks again!
__________________
X-Cart 4.0.12
Heavy modified with paid, free and forum mods.
PHP 5.2.5 | MYSQL 5.0.51a
Reply With Quote