coltrak Posted March 15, 2013 Share Posted March 15, 2013 (edited) Can someone more experienced have a look at my www.coltrak.com/sitemap.xml and www.coltrak.com/robots.txt I use PS 1.5 and google sitemap v 1.9 Am i wrong that the sitemap only shows .jpg links? Does it look correcy, i get invalid on several validators online Also why does my robots.txt block sitemap.xml Seems like a lot of problems regarding this. Where can i find a updated google sitemap module or is it better to make one on the free sitemap makers? also ive gotten this from google last weeks http://www.coltrak.com/: Increase in authorization permission errors Google detected a significant increase in the number of URLs we were blocked from crawling due to authorization permission errors. Recommended action Check the Crawl Errors page in Webmaster Tools. Check if your server or host is blocking Googlebot. If you don't want Google to crawl these pages, consider adding them to your robots.txt. Thanks Edited March 15, 2013 by coltrak (see edit history) Link to comment Share on other sites More sharing options...
coltrak Posted March 15, 2013 Author Share Posted March 15, 2013 is there anyone who can help me out here please?? Link to comment Share on other sites More sharing options...
coltrak Posted March 15, 2013 Author Share Posted March 15, 2013 hello someone gotta have a min to take a look and please tell me if they are ok or not? Link to comment Share on other sites More sharing options...
coltrak Posted March 17, 2013 Author Share Posted March 17, 2013 hrmmm anyone can maybe just take a look and say if its correct or not so i can in that case get someone to fix it...thanks in advance Link to comment Share on other sites More sharing options...
El Patron Posted March 18, 2013 Share Posted March 18, 2013 re robots.txt and sitemap # Sitemap Sitemap: http://coltrak.com/sitemap.xml this just tells bots where your sitemap is, it does not block it. Link to comment Share on other sites More sharing options...
El Patron Posted March 18, 2013 Share Posted March 18, 2013 it's odd, that the product is not in friendly url format...not sure that it particularly matters....you should search using googole 'prestashop 1.5 sitemap'. I have seen many community members posting on this sitemap and some have posted fixes for numerous features 'buts with a suit'. As for the actual webmaster reporting...it is often better to look at the google forums....they have more specific advice on sitemaps then might be found here.. Link to comment Share on other sites More sharing options...
coltrak Posted March 18, 2013 Author Share Posted March 18, 2013 Yea have been looking at all theese posts about changing the code in gsitemap module. Havent found a concrete solution yet though. What is the big benefit using the module from using for ex. http://www.xml-sitemaps.com Ive tried there and it supplies a huge sitemap with links to products etc. Link to comment Share on other sites More sharing options...
El Patron Posted March 18, 2013 Share Posted March 18, 2013 you wanted someone to review, see my comments above...the only fix I'd look for is setting your product to friendly url...otherwise I see no reason to change anything... Link to comment Share on other sites More sharing options...
coltrak Posted March 18, 2013 Author Share Posted March 18, 2013 well i get the error message in backoffice but the url`s are friendly, or what? i get them how i like in browser. I tried now to put up a free generated sitemap and see what happen in webmastertools, the urls are linked at least but it is so much smaller in size than the one generated by module...dont think the pics get indexed in the free generator Link to comment Share on other sites More sharing options...
FME_Modules Posted March 19, 2013 Share Posted March 19, 2013 The Robots.txt can be tested after submitting to webmaster. Plus no matter what module you use you have to edit the sitemap and this is required for each and every e-commerce websites. You can generate sitemap from the website you have mentioned above but later on you have to edit it to make sitemap SEO and Google friendly by removing unimportant URLs. You can see the sitemap and Robots.txt file of my website. http://www.fmemodules.com/sitemap.xml www.fmemodules.com/robots.txt Your robots.txt looks fine but as I said its best to test the robots.txt after submitting both sitemap and robots.txt in webmaster. I cannot find the sitemap on your website so cant say that is it ok or not. Link to comment Share on other sites More sharing options...
boopika Posted July 29, 2014 Share Posted July 29, 2014 I always check my robots.txt file from this tool find here http://seo-linkbuilding-lists.blogspot.com/2014/07/robotstxt-online-checker.html It's working ... Link to comment Share on other sites More sharing options...
Recommended Posts