Getting 'Access Denied' on directories not on pages

[mrduc]

At my website www.mysite.com, in the last few days getting multiple 'Access Denied' crawl errors in Google Webmaster tools. This error is happening only with my image directories and not web pages (exp: mysite.com/img/p/6/6/4/2). But when i view images in this directorie i can view it on my browser. Message from google "Googlebot couldn't crawl your URL because your server either requires authentication to access the page, or it is blocking Googlebot from accessing your site."

 

This is my robots.txt

User-agent: *
# Private pages
Disallow: /*controller=addresses
Disallow: /*controller=address
Disallow: /*controller=authentication
Disallow: /*controller=cart
Disallow: /*controller=history
Disallow: /*controller=identity
Disallow: /*controller=my-account
Disallow: /*controller=order
Disallow: /*controller=order-opc
Disallow: /*controller=order-slip
Disallow: /*controller=order-detail
Disallow: /*controller=order-follow
Disallow: /*controller=order-return
Disallow: /*controller=order-confirmation
Disallow: /*controller=password
Disallow: /*controller=pdf-invoice
Disallow: /*controller=pdf-order-return
Disallow: /*controller=pdf-order-slip
# Directories
Disallow: */classes/
Disallow: */config/
Disallow: */download/
Disallow: */mails/
Disallow: */translations/
Disallow: */tools/
# Files
Disallow: */page-non-trouvee
Disallow: */mot-de-passe-oublie
Disallow: */adresses
Disallow: */authentification
Disallow: */panier
Disallow: */bons-de-reduction
Disallow: */historique-des-commandes
Disallow: */identite
Disallow: */mon-compte
Disallow: */avoirs
Disallow: */commande
Disallow: */commande-rapide
Disallow: */confirmation-commande

Thanks in advance for any help from anyone.

[selectshop.at]

You should contact your provider. In the last months some providers are hardening their servers with firewalls and you will obtain exact this behaviour, when you blacklist or deny direct folder access wrongly on the firewall.

 

With your robots all is fine and no bot is denied for the directory /img.

[mrduc]

You should contact your provider. In the last months some providers are hardening their servers with firewalls and you will obtain exact this behaviour, when you blacklist or deny direct folder access wrongly on the firewall.

 

With your robots all is fine and no bot is denied for the directory /img.

 

Hi selectshop.at, thanks for your answer.

This is my provider's message:

"We do not put any firewall in front of your website because you have a dedicated server so the hosting of the website is up to you."

I am using VPS with CentOS 6. Can you tell me how can i config on my server?

[selectshop.at]

Who installed Centos for you ? The server was hardened ? Who is administrating the server ? CPanel, Plesk ? If you are using one of the Platfomrs, you should take a look into it, if there is a firewall or directory access added wrongly.

 

If no of boths is in use, so you should consult CentOS tutorials by search "deny access on directories".