Ben90 Posted June 3, 2015 Share Posted June 3, 2015 (edited) Hi guys, I'm using prestashop 1.6 and I realise robots.txt made the site blocked by Googlebot. I check robots.txt and I reckon it's alright. This is the screenshot of the error I got. We are on the page 1 of Google before, suddenly because of this thing, we are going down to second page. Please kindly take a look. Any advice would be appreciated. Maybe for temporary I need to delete the sitemap url inside robots.txt https://www.dropbox.com/s/62iavdbi2hi8vht/sitemap-test-result.JPG?dl=0 https://www.dropbox.com/s/nb7tvw1y6tjfk4t/blocked-by-robots.JPG?dl=0 Is there something wrong with my robots or sitemap? # robots.txt automaticaly generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/wc/robots.html User-agent: * # Private pages Disallow: /*orderby= Disallow: /*orderway= Disallow: /*tag= Disallow: /*id_currency= Disallow: /*search_query= Disallow: /*back= Disallow: /*n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-opc Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories Disallow: */classes/ Disallow: */config/ Disallow: */download/ Disallow: */mails/ Disallow: */modules/ Allow: */modules/homesliderpro/images Allow: */modules/homesliderpro/icons Disallow: */translations/ Disallow: */tools/ # Files Disallow: /forgot-your-password Disallow: /address Disallow: /addresses Disallow: /authentication Disallow: /cart Disallow: /discount Disallow: /order-history Disallow: /identity Disallow: /my-account Disallow: /order-follow Disallow: /order-slip Disallow: /order Disallow: /search Disallow: /quick-order Disallow: /guest-tracking Disallow: /marbleceramiccorp # Sitemap Sitemap: https://www.marbleceramiccorp.com.au/sitemap.xml Edited June 3, 2015 by Ben90 (see edit history) Link to comment Share on other sites More sharing options...
foduu1 Posted June 3, 2015 Share Posted June 3, 2015 no , all thing are right way Link to comment Share on other sites More sharing options...
Ben90 Posted June 4, 2015 Author Share Posted June 4, 2015 no , all thing are right way But meta description was blocked by Robots.txt when I search it on Google. Please somebody help... Link to comment Share on other sites More sharing options...
Ben90 Posted June 5, 2015 Author Share Posted June 5, 2015 (edited) Apparently, it's just the problem because I deleted the duplicated sitemap in webmaster tools. Now everything went well after google recognise the current one Edited July 3, 2015 by Ben90 (see edit history) Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now