X-Cart: shopping cart software

X-Cart forums (https://forum.x-cart.com/index.php)
-   Third Party Add-Ons for X-Cart 4 (https://forum.x-cart.com/forumdisplay.php?f=45)
-   -   Allowing access to news.php with DSEFU (https://forum.x-cart.com/showthread.php?t=39931)

Acquamarina 05-20-2008 02:47 PM

Allowing access to news.php with DSEFU
 
Hi,

I would like to know if spiders can be given access to the news.php page and how to create the exception. I know from my Google Webmaster Tools that News.php is blocked by DSEFU as it is a php file. Can anyone see a problem in allowing spiders to crawl? On my site at least, there is no version page with news.htm url. It is an easy way to add editorial content to the site but if the spiders bypass it, then it's wasted for SEO.

Does anybody see a problem in allowing index?

Thanks!

intel352 05-20-2008 02:49 PM

Re: Allowing access to news.php with DSEFU
 
Check your robots.txt file, likely news.php is listed there.

Acquamarina 05-20-2008 03:02 PM

Re: Allowing access to news.php with DSEFU
 
Hi, Jon,

Hope you are doing real well!

I checked the robots.txt and it has a serious of disallows but none for news.php. The page is not indexed in Google, so maybe it's just that, not indexed.

intel352 05-20-2008 03:07 PM

Re: Allowing access to news.php with DSEFU
 
Hi Vera, you could also check for a wildcard that blocks the .php extension, that may be the culprit. Something like *.php, maybe


All times are GMT -8. The time now is 08:36 AM.

Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.