digiboyz Posted October 26, 2010 Share Posted October 26, 2010 i use Generators to get a robots.txt:http://www.ndshop.jp/robots.txt'>http://www.ndshop.jp/robots.txt------Disallow: /cart.phpDisallow: /order.php------but google still index them, pls see here:site:www.ndshop.jphttp://www.google.com/search?hl=en&safe=off&q=site:www.ndshop.jp&btnG=SearchAbout 99 resultswhy?my site: http://www.ndshop.jp/ Link to comment Share on other sites More sharing options...
rocky Posted October 26, 2010 Share Posted October 26, 2010 It seems search engines don't always respect the robots.txt file. See here for code you can add to prevent search engines using the cart. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now