outblast Posted May 29, 2013 Share Posted May 29, 2013 Its ok to use Disallow: /category.php in robots.txt so google will not index anymore the categories? will this affect the indexation of my products? Link to comment Share on other sites More sharing options...
vekia Posted May 29, 2013 Share Posted May 29, 2013 it will not work as you expect, because the url (without friendly urls) to categories looks like: index.php?id_category=4&controller=category&id_lang=1 so if you want to block categories for robots - you should block urls one by one Link to comment Share on other sites More sharing options...
FME_Modules Posted May 30, 2013 Share Posted May 30, 2013 No it will not and yes the you can block directory and any URL coming from that directory will be restricted for Google to crawl. Link to comment Share on other sites More sharing options...
sunilmkt Posted May 30, 2013 Share Posted May 30, 2013 if you make seperate directory of folder for your product categary then you can disallow Google crawler by directory or folder name. User-agent: * Disallow: /folder1/ or User-agent: * Disallow: /dir1/ Disallow: /dir2/ Disallow: /dir3/ Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now