Jump to content

Unfriendly URLs

frontend

By frontend
in General topics

 Share

Recommended Posts

frontend Newbie

frontend

Posted
Posted (edited)

When i check my website for unfriendly URLs then this website: https://seositecheckup.com/tools/seo-friendly-url-test

 

Always shows me about 15 shopping cart urls on my website which are not friendly Urls.

 

Links like this example.

 

https://www.mysite.com/nl/winkelmandje?add=1&id_product=188&token=a4009ae7144dbef5f8ff2c0770f98da5

 

When i click on these links from my shop, it actually goes to a shopping cart from my shop with some products in it. 

 

So i wonder why these (not empty) shopping carts actually exist, but even more why this SEO checking website finds these url's  to those shopping carts.

 

 

In robot.txt acces is disabled 

Winkelmandje is actually dutch language for shoppingcart.

 

Disallow: /*nl/winkelmandje

 

 

Any suggestion how to fix this ?

 

Regards,

 

Bernhard.

Edited by frontend (see edit history)
Link to comment
Share on other sites
selectshop.at Newbie

selectshop.at

Posted
Posted

I wonder, why you want to have a shopping cart with friendly URL's ? There is no reason for that, and has also no SEO impact. Shopping carts are not read or indexed by serp's and it is not wise to change this behavior on the robots.txt. Cause in this case you will produce double content with different URL's.

 

Your site is a multi-language site or only one language ?

 

This is an original robots.txt PS 1.6. for a shop with only ONE language:

# robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
# http://www.prestashop.com - http://www.prestashop.com/forums
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
User-agent: *
# Allow Directives
Allow: */modules/*.css
Allow: */modules/*.js
# Private pages
Disallow: /*?orderby=
Disallow: /*?orderway=
Disallow: /*?tag=
Disallow: /*?id_currency=
Disallow: /*?search_query=
Disallow: /*?back=
Disallow: /*?n=
Disallow: /*&orderby=
Disallow: /*&orderway=
Disallow: /*&tag=
Disallow: /*&id_currency=
Disallow: /*&search_query=
Disallow: /*&back=
Disallow: /*&n=
Disallow: /*controller=addresses
Disallow: /*controller=address
Disallow: /*controller=authentication
Disallow: /*controller=cart
Disallow: /*controller=discount
Disallow: /*controller=footer
Disallow: /*controller=get-file
Disallow: /*controller=header
Disallow: /*controller=history
Disallow: /*controller=identity
Disallow: /*controller=images.inc
Disallow: /*controller=init
Disallow: /*controller=my-account
Disallow: /*controller=order
Disallow: /*controller=order-opc
Disallow: /*controller=order-slip
Disallow: /*controller=order-detail
Disallow: /*controller=order-follow
Disallow: /*controller=order-return
Disallow: /*controller=order-confirmation
Disallow: /*controller=pagination
Disallow: /*controller=password
Disallow: /*controller=pdf-invoice
Disallow: /*controller=pdf-order-return
Disallow: /*controller=pdf-order-slip
Disallow: /*controller=product-sort
Disallow: /*controller=search
Disallow: /*controller=statistics
Disallow: /*controller=attachment
Disallow: /*controller=guest-tracking
# Directories
Disallow: */classes/
Disallow: */config/
Disallow: */download/
Disallow: */mails/
Disallow: */modules/
Disallow: */translations/
Disallow: */tools/
Link to comment
Share on other sites
frontend Newbie

frontend

Posted
  • Author
Posted (edited)

Thanks for your reply,

 

 

After reading your remarks,

 

Actually, these are my questions which it seems you interpretate differently..

 

Question, i wonder why these (not empty) shopping carts actually exist, and can be seen by such a seo checker website.

 

What is the reason that this seositechecker find these 15 shoppingcarts on my website.

 

And how could i block this (to my idear not a good idear open shopping carts could be accesed and it will also lower the seo score, and google would also find these unfriendly urls)

 

Since my robot.txt is the same as yours, i also do not want any robot to see / find these carts.

 

And yes, my website is multilanguage. 

 

Regards,

 

Bernhard.

Edited by frontend (see edit history)
Link to comment
Share on other sites
selectshop.at Newbie

selectshop.at

Posted
Posted

If cart are indexed, so something got wrong with the serp. Is it Google ? If yes, than you can delete the links from your webmaster account. For other Serps, it could be that they indexed wrongly, this means they ignore the robots.

 

As you are not mentioning your URL, it is difficult to analyze and give you a proper answer, what really happened. Perhaps a pseudo crawler, or backlinks are the reason for the indexed carts. Some fake crawlers with bad behavior could disrupt your SEO as well. They ignore robots.txt. The only way is to forbid the access to your site, by honeypot for ex. or another tool.

 

If your site is multilanguage, than the robots should include also files in different languages

 

here a sample for a German and Portuguese, besides English shop:


# Files
Disallow: /*br/endereço
Disallow: /*br/endereços
Disallow: /*br/login
Disallow: /*br/carrinho
Disallow: /*br/desconto
Disallow: /*br/acompanhamento-do-convidado
Disallow: /*br/histórico-de-pedidos
Disallow: /*br/identificação
Disallow: /*br/minha-conta
Disallow: /*br/pedido
Disallow: /*br/confirmação-do-pedido
Disallow: /*br/acompanhar-meu-pedido
Disallow: /*br/pedido-imediato
Disallow: /*br/nota-do-pedido
Disallow: /*br/recuperar-senha
Disallow: /*br/procurar
Disallow: /*de/adresse
Disallow: /*de/adressen
Disallow: /*de/authentifizierung
Disallow: /*de/warenkorb
Disallow: /*de/discount
Disallow: /*de/auftragsverfolgung-gast
Disallow: /*de/bestellungsverlauf
Disallow: /*de/kennung
Disallow: /*de/mein-Konto
Disallow: /*de/bestellung
Disallow: /*de/bestellbestatigung
Disallow: /*de/bestellungsverfolgung
Disallow: /*de/schnell-bestellung
Disallow: /*de/bestellschein
Disallow: /*de/kennwort-wiederherstellung
Disallow: /*de/suche
Disallow: /*pt/endereço
Disallow: /*pt/endereços
Disallow: /*pt/login
Disallow: /*pt/carrinho
Disallow: /*pt/desconto
Disallow: /*pt/acompanhamento-do-convidado
Disallow: /*pt/histórico-de-pedidos
Disallow: /*pt/identificação
Disallow: /*pt/minha-conta
Disallow: /*pt/pedido
Disallow: /*pt/confirmação-do-pedido
Disallow: /*pt/acompanhar-meu-pedido
Disallow: /*pt/pedido-imediato
Disallow: /*pt/nota-do-pedido
Disallow: /*pt/recuperar-senha
Disallow: /*pt/procurar
Disallow: /*en/endereço
Disallow: /*en/endereços
Disallow: /*en/login
Disallow: /*en/carrinho
Disallow: /*en/desconto
Disallow: /*en/acompanhamento-do-convidado
Disallow: /*en/histórico-de-pedidos
Disallow: /*en/identificação
Disallow: /*en/minha-conta
Disallow: /*en/pedido
Disallow: /*en/confirmação-do-pedido
Disallow: /*en/acompanhar-meu-pedido
Disallow: /*en/pedido-imediato
Disallow: /*en/nota-do-pedido
Disallow: /*en/recuperar-senha
Disallow: /*en/procurar
Link to comment
Share on other sites
selectshop.at Newbie

selectshop.at

Posted
Posted

Here your find some good tips:

http://www.blogtips.org/web-crawlers-love-the-good-but-kill-the-bad-and-the-ugly/

http://www.botreports.com/badbots/

 

Be aware that bad bots IGNORE the robots.txt, so you need to ban them by another way. .htaccess will overload the server load, therefore I don't suggest to use this, only for a few bad bots it's ok, but not a whole list of hundred.

Link to comment
Share on other sites
selectshop.at Newbie

selectshop.at

Posted
Posted

When I click on the links SEOsitecheck ist mentioning, so there are none products in cart (cart is empty), which is correct behavior. Only when I click a second time, so after cookie session is set, I can see the carts. Which too is correct behavior, but only because I came from the link of seositecheck. For others, not, cause cookie-session is not passed on ! This means: cookie-session are not assumed by others.

You changed default parameters of the cookie sessions on Prestashop back-office ?

Tab "Administration" -> preferences -> lifetime cookie (both should set to 480) AND check the cookies IP's = YES.

 

One of your addons in use is causing the problem. Which one I cannot say (zopim, webwinkelkeur, or one payment option in use). There is a manipulation in the cookie session. You should delete all caches (smarty and browser) and try again, if you can access the carts seositecheck is mentioning,

 

Furthermore I've checked it your cart links were indexed by some bad behavior fake serps. It is not the case. You can check by yourself with search on Google "/nl/cart?add=1&id_product=361&token=615c3bd892b0595e756650d706b4216f", so it's not a robots.txt problem as well.

Link to comment
Share on other sites
frontend Newbie

frontend

Posted
  • Author
Posted

Hi, Yes from my shop these Cookie settings are the same (never changed it).

 

But, on may different webshop which are not mine i see the exact same reporting of shoppingcarts through different seo checking tools.

 

So why do these seo checking tools find these non existing shopping carts in the first place ? (i am just trying to understand).

 

I can show you 20 prestashop webshops which are not mine which give the same results (so it should no be due to modification or a added module i guess).

 

Regards,

 

Bernhard.

Link to comment
Share on other sites
selectshop.at Newbie

selectshop.at

Posted
Posted

Wrong server settings or software in use which opens this lack on cookie sessions. The reasons I named you before. Disable the extras you are using, especially the ones acting with cart (primary software which collects data and payment options which are not native Prestashop).

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...