Google Merchant Error

[idee]

Hi Everybody,

 

we have a many sites not getting crawled by Google Merchant Center. Support told us it is because the images cannot be crawled.
The reason, according Support, is a line in the robots.txt

Disallow: /*controller=images.inc

That is a standard line for prestashop robots.txt. So what is going in here?
Should/can we delete this line? 
 

Thanks for help

Idee

[Daresh]

It maybe bacause of images in module, try to add something like this at the beginning of your robots.txt file:

User-agent: *
# Allow Directives
Allow: */modules/*.css
Allow: */modules/*.js
Allow: */modules/*.jpg
Allow: */modules/*.jpeg
Allow: */modules/*.png

 

[idee]

Hey, thanks. I give it a try.
We have over 5000 products with errors, cause the image url cant be crawled. Its a disaster!

Edited December 19, 2018 by idee (see edit history)