sslayer Posted January 24, 2011 Share Posted January 24, 2011 I have created robots.txt and below is a copy of it with the pages and directories i want blocked.Still more than half of my indexed pages are like this:www.likeshop.ro/modules/.../sendtoafriend-form.php?id...22i got tons and tons of indexed pages with send to a friend , orders and other modules...i also uninstalled send to a friend module to get rid of this damn links... it's not workingin webmastertools it shows only 8 pages blocked by robots.txt and they are not from the modules... they are from the /cart/ and from /mails/please tell me what should i do, how can i fix this?My robots.txt file: User-agent: * Disallow: /classes/ Disallow: /config/ Disallow: /download/ Disallow: /mails/ Disallow: /modules/ Disallow: /translations/ Disallow: /tools/ Disallow: /addresses.php Disallow: /address.php Disallow: /authentication.php Disallow: /cart.php Disallow: /contact-form.php Disallow: /discount.php Disallow: /footer.php Disallow: /get-file.php Disallow: /header.php Disallow: /history.php Disallow: /identity.php Disallow: /images.inc.php Disallow: /init.php Disallow: /my-account.php Disallow: /order.php Disallow: /order-slip.php Disallow: /order-detail.php Disallow: /order-follow.php Disallow: /order-return.php Disallow: /order-confirmation.php Disallow: /pagination.php Disallow: /password.php Disallow: /pdf-invoice.php Disallow: /pdf-order-return.php Disallow: /pdf-order-slip.php Disallow: /product-sort.php Disallow: /search.php Disallow: /statistics.php Disallow: /zoom.php Link to comment Share on other sites More sharing options...
sslayer Posted January 27, 2011 Author Share Posted January 27, 2011 after 3 days still no reply? no-one knows the answer to this?or at least someone else having this issue? Link to comment Share on other sites More sharing options...
Never_give_up Posted February 10, 2011 Share Posted February 10, 2011 this works:Disallow: /sendtoafriend-form.phpDisallow: /sendtoafriend.phpORif you want to block ALL url's with certain text from google indexing, then add this:Disallow: /*sendtoafriend*Every url with sendtoafriend in the url will be DisallowHope this helps Link to comment Share on other sites More sharing options...
Hedrad Posted February 10, 2011 Share Posted February 10, 2011 Thanks for this tips. Link to comment Share on other sites More sharing options...
Paul C Posted February 10, 2011 Share Posted February 10, 2011 I would be very careful. Sometimes there are pages - like search results that could be of benefit to have indexed. I assume also that you don't have friendly urls enabled? If you do then the bots won't match links with your php files if they've been re-written.Paul Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now