X-Cart forums

[Manic]

Hi

I have the DSEFU installed a while ago. As I recalled it came with a robots.txt file.

I currently have warnings in my Google Webmaster Tools Sitemaps details saying:
"URLs roboted out
When we tested a sample of the URLs from your Sitemap, we found that the site's robots.txt file was blocking access to some of the URLs. If you don't intend to block some of the URLs contained in the Sitemap, please use our robots.txt analysis tool to verify that the URLs you submitted in your Sitemap are accessible by Googlebot. All accessible URLs will still be submitted."

Is this caused by the DSEFU robots.txt file? Should I be worried about this?

Thanks

[balinor]

robots.txt is meant to block your php urls so that you don't get duplicate content and also things that you don't want Google seeing like cart.php, help.php, etc. So no need to worry.

Moving to Third Party Add-Ons.

[Manic]

Thanks Balinor.

I wasn't sure after seeing the word "Warnings" in the Webmaster Tools.