jhd Posted September 6, 2014 Share Posted September 6, 2014 Hello, This tools, http://tool.motoricerca.info/robots-checker.phtml ,detects some error in the file robots.txt How can I clean? Best regards, This robots.txt file has some errors. They are marked in pink color. You can find some warnings at the bottom of the analysisHide empty and comments lines: The following block of code contains some errors. Please, remove all the reported errors and check again this robots.txt file. Line 1 # robots.txt automaticaly generated by PrestaShop e-commerce open-source solution Line 2 # http://www.prestashop.com - http://www.prestashop.com/forums Line 3 # This file is to prevent the crawling and indexing of certain parts Line 4 # of your site by web crawlers and spiders run by sites like Yahoo! Line 5 # and Google. By telling these "robots" where not to go on your site, Line 6 # you save bandwidth and server resources. Line 7 # For more information about the robots.txt standard, see: Line 8 # http://www.robotstxt.org/wc/robots.html Line 9 User-agent: * Line 10 # Private pages Line 11 Disallow: /*orderby= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 12 Disallow: /*orderway= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 13 Disallow: /*tag= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 14 Disallow: /*id_currency= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 15 Disallow: /*search_query= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 16 Disallow: /*back= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 17 Disallow: /*n= The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 18 Disallow: /*controller=addresses The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 19 Disallow: /*controller=address The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 20 Disallow: /*controller=authentication The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 21 Disallow: /*controller=cart The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 22 Disallow: /*controller=discount The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 23 Disallow: /*controller=footer The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 24 Disallow: /*controller=get-file The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 25 Disallow: /*controller=header The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 26 Disallow: /*controller=history The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 27 Disallow: /*controller=identity The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 28 Disallow: /*controller=images.inc The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 29 Disallow: /*controller=init The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 30 Disallow: /*controller=my-account The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 31 Disallow: /*controller=order The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 32 Disallow: /*controller=order-opc The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 33 Disallow: /*controller=order-slip The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 34 Disallow: /*controller=order-detail The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 35 Disallow: /*controller=order-follow The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 36 Disallow: /*controller=order-return The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 37 Disallow: /*controller=order-confirmation The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 38 Disallow: /*controller=pagination The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 39 Disallow: /*controller=password The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 40 Disallow: /*controller=pdf-invoice The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 41 Disallow: /*controller=pdf-order-return The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 42 Disallow: /*controller=pdf-order-slip The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 43 Disallow: /*controller=product-sort The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 44 Disallow: /*controller=search The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 45 Disallow: /*controller=statistics The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 46 Disallow: /*controller=attachment The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 47 Disallow: /*controller=guest-tracking The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). Line 48 # Directories Line 49 Disallow: */classes/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 50 Disallow: */config/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 51 Disallow: */download/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 52 Disallow: */mails/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 53 Disallow: */modules/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 54 Disallow: */translations/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 55 Disallow: */tools/ The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot). We advise you to start a file/directory name with a leading slash char (Example: /private.html). Line 56 # Files Line 57 Disallow: /direccion Line 58 Disallow: /direcciones Line 59 Disallow: /autenticacion Line 60 Disallow: /carro-de-la-compra Line 61 Disallow: /descuento Line 62 Disallow: /estado-pedido Line 63 Disallow: /historial-de-pedidos Line 64 Disallow: /identidad Line 65 Disallow: /mi-cuenta Line 66 Disallow: /carrito Line 67 Disallow: /confirmacion-pedido Line 68 Disallow: /devolucion-de-productos Line 69 Disallow: /pedido-rapido Line 70 Disallow: /vales Line 71 Disallow: /contrasena-olvidado Line 72 Disallow: /buscar Line 73 WARNING: The tool has found some directory paths that don't include a trailing slash character. Since a missing trailing slash can be both a deliberate decision or an error, and since this tool can't ipotize the real intentions of the webmaster, here follow some clarifications that could prevent a potential problem: The following command will disable just the directory "private" and all its contents:Disallow: /private/ ...while the following command will disable both the "private" directory and any file or directory path starting with the text "/private" (so "/private-eye.html", "/privateroom/page.html", etc.):Disallow: /private Please be sure to use the correct syntax, according to your needs. Robots.txt Checker Link to comment Share on other sites More sharing options...
El Patron Posted September 6, 2014 Share Posted September 6, 2014 what does Google say? https://support.google.com/webmasters/answer/6062598?hl=en tip: it's easy for 'some' testing domains to 'find' suspect issues that don't amount to a hill of beans, but it does make them see informational. 1 Link to comment Share on other sites More sharing options...
jhd Posted September 6, 2014 Author Share Posted September 6, 2014 I suspected that. I will use Webmaster Tools of Google. Thanks very much. Best regards 1 Link to comment Share on other sites More sharing options...
El Patron Posted September 7, 2014 Share Posted September 7, 2014 I suspected that. I will use Webmaster Tools of Google. Thanks very much. Best regards you are most welcome, we are at the point (except in China) of doing what google say do. Link to comment Share on other sites More sharing options...
jhd Posted September 12, 2014 Author Share Posted September 12, 2014 Hello!, Google say this: # robots.txt automaticaly generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/wc/robots.html User-agent: * # Private pages Disallow: /*orderby= Disallow: /*orderway= Disallow: /*tag= Disallow: /*id_currency= Disallow: /*search_query= Disallow: /*back= Disallow: /*n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-opc Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories Disallow: */classes/ Disallow: */config/ Disallow: */download/ Disallow: */mails/ Disallow: */modules/ Disallow: */translations/ Disallow: */tools/ 0 Errors 0 Warnings Sitemaps You have not submitted any sitemaps for this site. How do I add a Sitemap? Site Errors No errors detected in the last 90 days. Nice! Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now