carsten Posted March 19, 2014 Share Posted March 19, 2014 Hi I am going to move content from an OS Commerce webshop to a prestashop. But want to make sure that duplicate content is avoided while I test the new prestashop. Will it be enough to add a robot.txt file in the root of the library with the following content User-agent: * Disallow: / Or are there any modules handling this issue? Regards, Carsten Link to comment Share on other sites More sharing options...
Ciseur Posted March 19, 2014 Share Posted March 19, 2014 Hello Carsten, When you are on a test environment the best way to be sure that bots will not access to it is to deploy a HTTP authentification. Only logged in user can acces to the test website and it prevents you from getting indexed in search engines. On an apache server, you can do it with an .htacces and an .htpasswd. Hope it helps, Best regards, Ciseur 1 Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now