nicola82 Posted December 11, 2014 Share Posted December 11, 2014 I was checking my shop and I noticed that my cards are crawlable by google. That seems strange to me. So, I went to check it into my Google Webmaster tool ( see as google) and I noticed that: mysite/shop/carrello?add=1&id_product=109&token=a5940fddb0cebe0a7d1efc3d0e0859b3 and many other cards are crawlable. I checked the robots.txt in the shop root /shop/ and I found: Disallow: /carrello Since it does not seem to work well I've added: Disallow: /carrello?* Disallow: /carrello* I checked it again and the Google W Tool still says that is crawlable. Could you help me to figure out Where the problem is? Link to comment Share on other sites More sharing options...
nicola82 Posted December 11, 2014 Author Share Posted December 11, 2014 mmm, I think that the mistake was the position of the robots.txt in the shop root instead of the site root. I've put it in the site root and it seems to work. Link to comment Share on other sites More sharing options...
Recommended Posts