Robot blocking google bot

[ellisandwren]

Hi all

 

I've just signed up to Google Webmaster, but I'm getting an 'Unreachable' error message when I run a 'fetch and render' function.

 

Hours later and I'm wondering if it could be related to my robot file, please see below...

 

# robots.txt automaticaly generated by PrestaShop e-commerce open-source solution

# http://www.prestashop.com - http://www.prestashop.com/forums

# This file is to prevent the crawling and indexing of certain parts

# of your site by web crawlers and spiders run by sites like Yahoo!

# and Google. By telling these "robots" where not to go on your site,

# you save bandwidth and server resources.

# For more information about the robots.txt standard, see:

# http://www.robotstxt.org/robotstxt.html

User-agent: *

# Allow Directives

Allow: */modules/*.css

Allow: */modules/*.js

# Private pages

Disallow: /*?orderby=

Disallow: /*?orderway=

Disallow: /*?tag=

Disallow: /*?id_currency=

Disallow: /*?search_query=

Disallow: /*?back=

Disallow: /*?n=

Disallow: /*&orderby=

Disallow: /*&orderway=

Disallow: /*&tag=

Disallow: /*&id_currency=

Disallow: /*&search_query=

Disallow: /*&back=

Disallow: /*&n=

Disallow: /*controller=addresses

Disallow: /*controller=address

Disallow: /*controller=authentication

Disallow: /*controller=cart

Disallow: /*controller=discount

Disallow: /*controller=footer

Disallow: /*controller=get-file

Disallow: /*controller=header

Disallow: /*controller=history

Disallow: /*controller=identity

Disallow: /*controller=images.inc

Disallow: /*controller=init

Disallow: /*controller=my-account

Disallow: /*controller=order

Disallow: /*controller=order-opc

Disallow: /*controller=order-slip

Disallow: /*controller=order-detail

Disallow: /*controller=order-follow

Disallow: /*controller=order-return

Disallow: /*controller=order-confirmation

Disallow: /*controller=pagination

Disallow: /*controller=password

Disallow: /*controller=pdf-invoice

Disallow: /*controller=pdf-order-return

Disallow: /*controller=pdf-order-slip

Disallow: /*controller=product-sort

Disallow: /*controller=search

Disallow: /*controller=statistics

Disallow: /*controller=attachment

Disallow: /*controller=guest-tracking

# Directories

Disallow: */classes/

Disallow: */config/

Disallow: */download/

Disallow: */mails/

Disallow: */modules/

Disallow: */translations/

Disallow: */tools/

# Files

Disallow: /*password-recovery

Disallow: /*address

Disallow: /*addresses

Disallow: /*login

Disallow: /*cart

Disallow: /*discount

Disallow: /*order-history

Disallow: /*identity

Disallow: /*my-account

Disallow: /*order-follow

Disallow: /*credit-slip

Disallow: /*order

Disallow: /*search

Disallow: /*quick-order

Disallow: /*guest-tracking

Disallow: /*order-confirmation

# Sitemap

Sitemap: https://ellisandwren.com/1_index_sitemap.xml

 

Anything obvious please?

 

I've contacted my web hosts and they have said nothing is blocking Google their end.

 

Thanks in advance.

[xaxa]

Hello,

do you fix the problem ?

Thanks!

[Michi001]

i know this topic is a little bit older, but if someone need the solution:

You need to insert the following lines manually in the robots.txt:

User-agent: Googlebot
Disallow:

User-agent: Googlebot-image
Disallow: