If you're a user of XML Sitemaps Commercial version (
http://www.xml-sitemaps.com/), a good application that generates sitemap.xml files for your store, then this information is pertinent to you:
Quote:
|
Originally Posted by intel352
Regarding xml-sitemaps commercial application, I spoke with the author this week, it turns out you can change the UserAgent value via a manual config value specification.
Quote:
|
Originally Posted by Oleg Ignatiuk
you can customize user-agent identifier in config.inc.php file:
Code:
'xs_crawl_ident' => 'GoogleBot/1.0',
|
This is specifically helpful for XC SEO users, as the sitemap is then seen as a legitimate bot, and the URLs are cleaned up accordingly. |