X-Cart: shopping cart software

X-Cart forums (https://forum.x-cart.com/index.php)
-   Changing design (https://forum.x-cart.com/forumdisplay.php?f=51)
-   -   google images search results drop after CDN (https://forum.x-cart.com/showthread.php?t=75114)

anandat 03-20-2017 09:44 PM

google images search results drop after CDN
 
I have recently installed CDN module but after that google images search results has been drop almost to nil.
According CDN company guidelines you have to disallow robots under https://cdn.mysite.com with
User-agent: *
Disallow: /

so that robots must crawl with original source i.e https://www.mysite.com & google will not penalize you for duplicate content

Any of you are facing same issue after going with maxcdn , cloudflare etc?

I am thinking of another idea by providing images site map to google but I guess there is not software available for x-cart to generate images site map of products with thumbnail & detail images for products.

qualiteam 03-21-2017 08:42 PM

Re: google images search results drop after CDN
 
Quote:

User-agent: *
Disallow: /

so that robots must crawl with original source


How do they explain this? As far as I understand all images are linked to the CDN domain, and there are no links to the original images hosted on your server. How will the crawler ever find them to index?

anandat 03-21-2017 09:45 PM

Re: google images search results drop after CDN
 
Hi Alex,
All cdn images have link at primary domain.
but robots.txt of https://cdn.mysite.com has

User-agent: *
Disallow: /

So I guess google bots not able to crawl https://cdn.mysite.com even though all products images links are there at https://www.mysite.com

So one idea is to use following robots.txt at https://cdn.mysite.com
User-agent: *
Disallow: /
Allow: /images/

This way google bots can only access images only at https://cdn.mysite.com & not any other content. And you have to first add url cdn.mysite.com at google webmaster tools so google bots come to know that mysite.com is interlinked with cdn.mysite.com. I have verified cdn.mysite.com using google analytics code method so it will consider both site as same.

This is what my logic.

The other idea is to upload products-sitemap with images url at https://www.mysite.com but there is no such site map generator is available for x-cart :(

I want to know how other people have successfully managed with CDN without losing images in google search results.


All times are GMT -8. The time now is 12:32 PM.

Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.