Jeet Kune Do Posted November 26, 2010 Share Posted November 26, 2010 Hi all.How can I make cms pages no index, no follow by the website crawlers?Thank you for any suggestions.Best regards! Link to comment Share on other sites More sharing options...
rocky Posted November 27, 2010 Share Posted November 27, 2010 Edit robots.txt in the root directory of PrestaShop and add: Disallow: /cms.php or if your shop is in a subdirectory called shop: Disallow: /shop/cms.php If you don't have a robots.txt file, create a blank one with chmod 666 permissions, then go to Tools > Generators and click "Generate robots.txt file". Link to comment Share on other sites More sharing options...
Jeet Kune Do Posted November 27, 2010 Author Share Posted November 27, 2010 #rocky, you always there where we needed. Thank you!So If I understand right it should no index no follow every pages I create in CMS like delivery, terms and conditions etc.What about if I would like to index and follow only one page in CMS like for example an article and disallow others?I wish edit the title of the threat to [solved]. How can I do that? Link to comment Share on other sites More sharing options...
Jeet Kune Do Posted November 27, 2010 Author Share Posted November 27, 2010 In the robots.txt I have also disabled /modules directory this is fine, but what about if I would like to index for example the module top horizontal menu which contain important links or the sidebox category. Should I delete the directory /module form robots txt and disabled every single module which I don't want to get indexed? Is other ways to do it?I would like my "top horizontal menu" to get index for some links, but inside it have delivery, payments, terms of conditions that I don't want to get indexed. Ok, no problem I disabled CMS in robots.txt, but the CMS pages have a article page that I would like to index. I hope I explained my self. Link to comment Share on other sites More sharing options...
rocky Posted November 28, 2010 Share Posted November 28, 2010 You don't need to unblock the top horizontal menu or category module, since the links lead to places outside the modules directory. Unfortunately, I don't know how to block only certain CMS pages, only all or none. Link to comment Share on other sites More sharing options...
Jeet Kune Do Posted November 29, 2010 Author Share Posted November 29, 2010 Ok.Thank you for your help!Best regards! Link to comment Share on other sites More sharing options...
petek Posted January 20, 2011 Share Posted January 20, 2011 Edit robots.txt in the root directory of PrestaShop and add: Disallow: /cms.php or if your shop is in a subdirectory called shop: Disallow: /shop/cms.php If you don't have a robots.txt file, create a blank one with chmod 666 permissions, then go to Tools > Generators and click "Generate robots.txt file". Hi, I followed your instructions but Google has still indexed at least one of the cms pages. Would it help if I disallowed the "content" folder which is where the cms pages appear to reside ? Or would this disallow valid content which I want indexed ? Link to comment Share on other sites More sharing options...
rocky Posted January 22, 2011 Share Posted January 22, 2011 No, that wouldn't help, since the content directory doesn't actually exist. Some search engines simply ignore the robots.txt. In that case, there isn't much you can do. Link to comment Share on other sites More sharing options...
petek Posted January 22, 2011 Share Posted January 22, 2011 No, that wouldn't help, since the content directory doesn't actually exist. Some search engines simply ignore the robots.txt. In that case, there isn't much you can do. Damn it, I don't particularly want my general conditions appearing before all and sundry ! I have another site developed under Zen Cart and I don't have a problem there. Link to comment Share on other sites More sharing options...
sslayer Posted January 24, 2011 Share Posted January 24, 2011 sorry, i started a new topic about my problem. Link to comment Share on other sites More sharing options...
anze Posted February 3, 2011 Share Posted February 3, 2011 Can you put no index no follow, in files directly not in robots.txt Link to comment Share on other sites More sharing options...
Theisbj Posted June 25, 2011 Share Posted June 25, 2011 Edit robots.txt in the root directory of PrestaShop and add: Disallow: /cms.php or if your shop is in a subdirectory called shop: Disallow: /shop/cms.php If you don't have a robots.txt file, create a blank one with chmod 666 permissions, then go to Tools > Generators and click "Generate robots.txt file". Hi, I followed your instructions but Google has still indexed at least one of the cms pages. Would it help if I disallowed the "content" folder which is where the cms pages appear to reside ? Or would this disallow valid content which I want indexed ? The problem is that robots.txt is for crawlers and can't be used if the pages are already in Google index.You should use no index for these pages.And it actually makes it worse to have them in robots.txt. Because the crawlers will get to robots.txt and see that it shouldn't visit these pages. So remove them from robots.txt and add noindex to them. Link to comment Share on other sites More sharing options...
nipun Posted May 29, 2014 Share Posted May 29, 2014 hi ,how can i add noindex & nofollow in particular CMS page Like {* /content/9-featured-products-blog *} and particular CATEGORY page Like {* /30-testing*} In PrestaShop V. 1.5.6Please Helpthank you Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now