Rhobur Posted February 18, 2012 Share Posted February 18, 2012 I have thousands of crawls errors due to robots.txt restrictions; part of them are understandable, one cannot allow acces to some files or folders but a lot of these WMT errrors are coming from my site search, for ex. http://www.caprice-shop.ro/search.php?tag=verighete%205.5%20mm I have just commented out the line Disallow: /search.php in robots.txt. Is this OK ? Or should I let it in effect ? Have a nice weekend everybody! Link to comment Share on other sites More sharing options...
Recommended Posts