Jump to content

robots.txt test site... is that correct?


Recommended Posts

Hi everybody!

 

I recently found this test site to check if the robots.txt file is correcly writed: http://tool.motoricerca.info/robots-checker.phtml

 

I've checked my domain http://nutri-cosmetica.com but I found severeal "warnings"... should I pay atemption to them? or not?

 

I though prestashop was optimized to create robots.txt file so I never manualy edit the robots.txt file...

 

Thanks for your help,

Regards!

Link to comment
Share on other sites

why not post what specially it is reporting...unanswered posts are typically caused by a lack of information..

 

so state exactly what the question is and maybe someone can help you...

 

Hi elpatron!

 

Thanks for your answer....

 

The error code list that I get at that webiste was so long so thouhg that people would prefer to see it at the original robot-checker-website.

 

You just have to enter: http://tool.motoricerca.info/robots-checker.phtml

 

and type my url: http://nutri-cosmetica.com/robots.txt

 

Then you'll get a list full of errors like this one:

Line 11 Disallow: /*orderby=

The "*" wildchar in file names is not supported by (all) the user-agents addressed by this block of code. You should use the wildchar "*" in a block of code exclusively addressed to spiders that support the wildchar (Eg. Googlebot).

 

 

I hope it helps.... thanks!

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...