Blocking Pages Using Robots

[Vilas]

Hello Friends,

 

I wanted to know anyone have any idea about blocking certain pages using robot.txt?

 

I wanted to block all pages to be crawl by all search engines.

 

Pages I wanted to block

 

manufacturer ( all brands )

 

suppliers ( all suppliers )

 

Will be great if anyone help in this regards.

 

Thanks & Regards

 

 

[Vilas]

will be great if you tell us what changes to be done to block manufacture pages?

[Zohaib-fk]

Hi,

 

Could you check with Disallow: url of pages or folder to be block access.

 

Another solution is inform search engine bot not to index or crawl web pages with following code

<meta name="robots" content="noindex, nofollow">
<meta name="googlebot" content="noindex, nofollow">

[Vilas]

Hi,

 

That will block complete website indexing.

 

We only wanted to block certain pages those are realted to manufacture.

 

i.e. domain name /manufacturer

 

& domain name /id_manufacturer name

 

Thanks

[selectshop.at]

After blocking the pages don't forget to exclude them form the sitemap. On Google Sitemap module you can exclude them.

 

The best possibility to block suppliers and manufacturer, is to don't use the module. Disable them, than the yould not be crawled.

Edited August 3, 2015 by selectshop.at (see edit history)

[Zohaib-fk]

You need to put some programming condition like if -else ,so that only manufacturer or supplier pages have meta tags.

In other pages those meta tags will not be included therefore they will be index and manufacturer ,supplier pages will have meta tags for disable indexing.

Also remove them from sitemap, all webmasters tools.

PrestaShop Tutorials Videos [How to do Tasks]

https://www.prestashop.com/forums/topic/907438-prestashop-tutorials-videos-how-to-do-tasks/

Edited June 26, 2021 by Zohaib-fk
Post Updated (see edit history)