X-Cart forums

[Miniature-Giant]

I noticed that you seem to have the "printable" pages NOT appearing for the robots. Is this to reduce the chances of "duplicate content"?

The printable and non-printable pages are different (printable is missing the nav bars, etc.), any idea how sensitive the spiders are to duplicate content, I mean, I have a lot of reused descriptions of policies, general condition, etc. on each page -- do they only get upset if the pages are truely identical, or if they are just very similar (matching text blocks)?

It would seem that if they only freak on identical pages, then having the extra pages with context matching and keyword matching content (that the printable pages provide) would be a plus. Thoughts?

Thanks,
James

[Miniature-Giant]

Well, I set the number of products per page to 1000, that makes all categories appear on only one page, but is a bit messy for users. XML-Sitemaps still can't handle the site -- bogs down to the point of failure.
Trying enarion.net now. I have it set to show me a status every 295 seconds. in its status reports it shows the pages that it is currently working on. Eighteen of them in the last status view were:

Info: Computing http://www.miniature-giant.com/special-edition-Reaper-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-productcode-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-productcode-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-productcode-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-productcode-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-title-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-title-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-title-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-title-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-price-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-price-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-price-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-price-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-orderby-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-orderby-up-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-orderby-down-c-410.html
Info: Computing http://www.miniature-giant.com/special-edition-Reaper-print-orderby-down-c-410.html

I am only aware of one link to this category (#410). Any idea where all of these other ones could be coming from? Is this a problem with enarion and I should just try another sitemap generator? Do you think that I might have a real problem with the way that the XC SEO mod is operating, or does this sound reasonable to you?

Thanks for any advice or assurances.
James

[Jerrad]

Try this sitemap generator: http://gsitecrawler.com

Works great for me with the XC SEO mod!

[intel352]

MiniG, the reason those "bots" that you employed did not see the website as a search engine, is because what determines a search engine in x-cart is the bots.php file, and the bots.php file apparently doesn't list the user agents that those search engines reported.

What that means is, while google reports itself as GoogleBot, and is detected properly by X-Cart, other lesser-known search engines won't be detected because X-Cart doesn't know of their existence.

So, as Jerrad mentioned, something like gsitecrawler would work, assuming that it identifies itself as a Googlebot

[gastu]

problems..
i install all sql and change all files and not work.

Not Found

The requested document was not found on this server.

[intel352]

yes, again, this problem is due to either you not incorporating the needed changes into your .htaccess file, OR your server does not support mod_rewrite.

Please show us the content of your existing .htaccess file so we can verify that you modified it correctly.

[gastu]

site work with rewrite.

.htaccess

DirectoryIndex home.php
RewriteEngine On
RewriteCond %{HTTP_HOST} ^oficlip.cl$
RewriteRule ^(.*)$ http://www.oficlip.cl/$1 [R=301,L]

#####
# The following rules should be added
# to the TOP of your existing .htaccess file
# to prevent malicious users/bots from accessing
# x-cart files that aren't meant to be public.
#####

# block all smarty templates (no reason to have these exposed) 
RedirectMatch gone ^/.*\.tpl$ 

# block all .log (log files), .sql (sql dump/export) and .conf (config files) files 
# in case some day these files move to another directory 
RedirectMatch gone ^.*\.(sql|log|conf)$ 

# block access to the 'Smarty-*' directory 
RedirectMatch gone ^.*Smarty.*$ 

# block common X-Cart files that could reveal
# that you have X-Cart installed
RedirectMatch gone VERSION.*
RedirectMatch gone COPYRIGHT.*
RedirectMatch gone INSTALL.*
RedirectMatch gone NEW.*
RedirectMatch gone README.*
RedirectMatch gone UPGRADE.*

# block access to /upgrade 
Redirect gone /upgrade 

# block access to /skin1_original 
Redirect gone /skin1_original 

# block access to the /sql directory 
Redirect gone /sql 

# block access to the /shipping directory 
Redirect gone /shipping 

# block access to the pgp directories 
Redirect gone /.pgp 
Redirect gone /.pgp.def

# block access to the pgp directories 
Redirect gone /tmp 
Redirect gone /var

[intel352]

Yep, that's the problem, you didn't modify your .htaccess file... Look at the files that you downloaded, there is a .htaccess file, please copy the contents of that .htaccess file into your existing .htaccess file.

[gastu]

already paste my .htaccess and have your secure.htaccess
now what :s

[gastu]

.htaccess hide in different OS.
in my case i use macosx and not view .htaccess.

Options +FollowSymLinks
RewriteEngine On

# Some servers require the Rewritebase directive to be
# enabled (remove '#' at the beginning to activate)
# Please note: when enabled, you must include the path
# to your root xcart folder (i.e. RewriteBase /shop)
#RewriteBase /

# Enable the following 3 lines if you want to make sure
# all users use the www. version of your domain.
# Helps prevent cookie issues for some X-Cart installations
#RewriteCond %{HTTPS} off
#RewriteCond %{HTTP_HOST} ^YOURDOMAIN.com [NC] 
#RewriteRule ^(.*)$ http://www.YOURDOMAIN.com/$1 [R=301,L]

##### XC SEO Lite
# Rewrite SEO category URL's
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-up-c-([0-9]+)-p-([0-9]+)\.html$	$1home.php?printable=Y&sort=$2&sort_direction=0&cat=$3&page=$4		[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-down-c-([0-9]+)-p-([0-9]+)\.html$	$1home.php?printable=Y&sort=$2&sort_direction=1&cat=$3&page=$4		[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-c-([0-9]+)-p-([0-9]+)\.html$												$1home.php?printable=Y&cat=$2&page=$3		[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-up-c-([0-9]+)-p-([0-9]+)\.html$		$1home.php?sort=$2&sort_direction=0&cat=$3&page=$4		[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-down-c-([0-9]+)-p-([0-9]+)\.html$		$1home.php?sort=$2&sort_direction=1&cat=$3&page=$4		[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-c-([0-9]+)-p-([0-9]+)\.html$													$1home.php?cat=$2&page=$3		[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-up-c-([0-9]+)\.html$				$1home.php?printable=Y&sort=$2&sort_direction=0&cat=$3				[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-down-c-([0-9]+)\.html$				$1home.php?printable=Y&sort=$2&sort_direction=1&cat=$3				[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-c-([0-9]+)\.html$															$1home.php?printable=Y&cat=$2				[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-up-c-([0-9]+)\.html$					$1home.php?sort=$2&sort_direction=0&cat=$3				[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-down-c-([0-9]+)\.html$					$1home.php?sort=$2&sort_direction=1&cat=$3				[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-c-([0-9]+)\.html$																$1home.php?cat=$2				[QSA,L]

# Rewrite SEO manufacturers URL's
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-up-m-([0-9]+)-p-([0-9]+)\.html$	$1manufacturers.php?printable=Y&sort=$2&sort_direction=0&manufacturerid=$3&page=$4	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-down-m-([0-9]+)-p-([0-9]+)\.html$	$1manufacturers.php?printable=Y&sort=$2&sort_direction=1&manufacturerid=$3&page=$4	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-m-([0-9]+)-p-([0-9]+)\.html$	$1manufacturers.php?printable=Y&manufacturerid=$2&page=$3	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-up-m-([0-9]+)-p-([0-9]+)\.html$	$1manufacturers.php?sort=$2&sort_direction=0&manufacturerid=$3&page=$4	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-down-m-([0-9]+)-p-([0-9]+)\.html$	$1manufacturers.php?sort=$2&sort_direction=1&manufacturerid=$3&page=$4	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-m-([0-9]+)-p-([0-9]+)\.html$		$1manufacturers.php?manufacturerid=$2&page=$3	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-up-m-([0-9]+)\.html$	$1manufacturers.php?printable=Y&sort=$2&sort_direction=0&manufacturerid=$3	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-(productcode|title|price|orderby)-down-m-([0-9]+)\.html$	$1manufacturers.php?printable=Y&sort=$2&sort_direction=1&manufacturerid=$3	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-m-([0-9]+)\.html$				$1manufacturers.php?printable=Y&manufacturerid=$2			[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-up-m-([0-9]+)\.html$	$1manufacturers.php?sort=$2&sort_direction=0&manufacturerid=$3	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-(productcode|title|price|orderby)-down-m-([0-9]+)\.html$	$1manufacturers.php?sort=$2&sort_direction=1&manufacturerid=$3	[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-m-([0-9]+)\.html$					$1manufacturers.php?manufacturerid=$2			[QSA,L]

# Rewrite SEO product URL's
RewriteRule ^([^/]*/)?[^/]+-print-c-([0-9]+)-p-([0-9]+)-pr-([0-9]+)\.html$		$1product.php?printable=Y&productid=$4&cat=$2&page=$3						[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-c-([0-9]+)-p-([0-9]+)-pr-([0-9]+)\.html$			$1product.php?productid=$4&cat=$2&page=$3						[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-print-pr-([0-9]+)\.html$							$1product.php?printable=Y&productid=$2						[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-pr-([0-9]+)\.html$									$1product.php?productid=$2						[QSA,L]

# Rewrite SEO static page URL's
RewriteRule ^([^/]*/)?[^/]+-print-pg-([0-9]+)\.html$	$1pages.php?printable=Y&pageid=$2						[QSA,L]
RewriteRule ^([^/]*/)?[^/]+-pg-([0-9]+)\.html$			$1pages.php?pageid=$2						[QSA,L]

# Rewrite SEO search URL's
RewriteRule ^([^/]*/)?([^/]+)-search-c-([0-9]+)(-[^-]+)*\.html$	$1search.php?mode=search&substring=$2&cat=$3		[QSA,L]
RewriteRule ^([^/]*/)?([^/]+)-search(-[^-]+)*\.html$	$1search.php?mode=search&substring=$2		[QSA,L]
##### / XC SEO Lite