Robot.txt in root - prestashop in subdirectory

[thomaslester]

Hello!

 

My prestashop is in a subdirectory - the robot.txt has to be in the root as far as I understand.

 

Can the robot.txt that Prestashop generates just be moved to the root as is, or do I have to change it to make it work?

 

 

Generated lines examples:

# Private pages

Disallow: /*orderby=

 

# Directories

Disallow: */classes/

 

# Files

Disallow: /*en/password-recovery

 

OR do I have to indicate that Prestashop is in the subdirectory /webshop/

 

Best Thomas

 

 

[El Patron]

for all intentional purposes, your installation directory to outside world is your root directory, so where you have your installation is where this file goes

[thomaslester]

Thank you for your answer.

 

It´s not clear to me when you say "your installation directory"

 

My prestashop is located in www.xxxx.eu/webshop/ so do the file go to www.xxxx.eu or www.xxxx.eu/webshop/

 

And is the file generated by prestashop designed to be moved outside the main prestashop directory?

 

As far as I have understood the robot.txt has to be in the domain root directory - or?

 

Best T

[El Patron]

it would go here...this is where ps will generate file

 

www.xxxx.eu/webshop/

[thomaslester]

Thank you again.

 

Just found a different answer on http://www.robotstxt.org/robotstxt.html.

 

Seems that it will only work if the file is places in the level of www.xxxx.eu/

Also I would have a difficult time getting Google Webmaste tool to find it in a subdirectory - I guess!

 

The big question for me is now if the file generated by prestashop has the right settings for beeng places outside the prestashop folder.

I don´t know the variables in the robot.txt and dont know if they block the right files and directories in the prestashop folder.

 

any ideas?

 

best Thomas

[El Patron]

Thank you again.

 

Just found a different answer on http://www.robotstxt.org/robotstxt.html.

 

Seems that it will only work if the file is places in the level of www.xxxx.eu/

Also I would have a difficult time getting Google Webmaste tool to find it in a subdirectory - I guess!

 

The big question for me is now if the file generated by prestashop has the right settings for beeng places outside the prestashop folder.

I don´t know the variables in the robot.txt and dont know if they block the right files and directories in the prestashop folder.

 

any ideas?

 

best Thomas

 

ah, good post, I had not realized this...thanks for sharing.

 

maybe there is something from google that can help us

 

https://support.google.com/webmasters/answer/40361?hl=en

[thomaslester]

Maybe.

 

For the first lines I think is is like this:

 

# Private pages
Disallow: /*orderby=
Disallow: /*orderway=

etc.

Should be set to:

 

# Private pages
Disallow: /webshop/*orderby=
Disallow: /webshop/*orderway=

 

But how do I alter these to be correct?

 

Disallow: */classes/
Disallow: */config/

??????
 

[El Patron]

according to google you can only do it this way

https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag?csw=1

 

possible to look at pages that ps creates in robot file then check shop page and see if already no-index

[El Patron]

I pm'ed resident expert to have a look at this.

 

were waiting Leslie.

[Dh42]

The first lines are correct, the last lines you would alter like */webshop/classes/ */webshop/config/

[El Patron]

The first lines are correct, the last lines you would alter like */webshop/classes/ */webshop/config/

 

would this not be stripped as well?  dang I confused about this subject...

[thomaslester]

Thank you som much. Seems right to me. A great help.

 

No it would not be stripped. What is stripped is the URL when looking for the robot.txt file. 

The content of the robot.txt will tell robotswhat to disallow for the root and all directories and files below.

 

Best Thomas