My site is crawled too fast and I got supended.

[fjanos]

I don't know what to do with this issue. Please anyone can help me. My webhosting company suspended my site because of this quote:

"System administration has identified your account as using higher resources on the server housing your account. This is impacting other users, and we may be forced to suspend or have already suspended your site in order to stabilize the server.

 

We noticed that your site (Prestahsop based site), VARIABLE_1, is being heavily 'crawled' by search engines. Search engines tend to mimic the effect of hundreds of visitors going through every portion of your site, often all at once.

 

You may wish to implement a robots.txt file in order to reduce this effect. This file contains instructions for well behaving 'robots' on how to crawl your site. You can find more information about this here:

http://www.robotstxt.org/.

 

The basic format would be as follows to block robots from the following (example) directories:

 

User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

Disallow: /tmp/

Disallow: /private/

 

To use this effectively, you will need to review your site and see what parts might be the most intensive. An alternative to blocking a search engine is to request their robots to not crawl through your site as quickly as they normally would. It is an unofficial extension to the robots.txt standard but one that most popular search engines use. This is an example of how you request robots request pages only every ten seconds:

 

User-agent: *

Crawl-delay: 10

 

This is especially useful for parts of your sites like forums or 'tag clouds' that, while useful to human visitors, are troublesome in terms of how robots aggressively pass through them repeatedly.

 

You can also use your access logs to see how search engines are hitting your site. Let us know if you need help finding your logs in our control panel and we'll be glad to help.

 

If your site is currently suspended, please contact us to lift the suspension in order to implement the above recommendation. As always, feel free to contact us with any further questions."

Would these recomendations really help? I have many problems with Prestashop SEO lately.

[Ronaldo Perez]

1. bad webhosting

2. in settings in Google webmaster tools, there are also recommendations for the bot - how often to index your site

[LovePrestashop]

change the web hosting company and it will solve the issue

[OC2PS]

Absolutely change the host.

 

But in the meantime, change the crawl settings in Google Webmaster Tools to make Google crawl more slowly.

[airmax360fr]

You can apply a Independent ip from your host. So it will not be limited