renton4 Posted March 27, 2017 Share Posted March 27, 2017 (edited) Hi, I have noticed that my web-site isn't indexed by search bots for example by Yandex/Bot. I have started tcpdump and found out that if a request comes without cookies then web-site responses with header Location and Set-Cookie. OK. But the search bot doesn't use cookies and makes its next request also without them and again receives same Location, Set-Cookie, Redirect. And so it continues endlessly this way. Is this the bug of CMS, admin CMS settings or something else? _PS_VERSION_, 1.5.5.0 HEAD / HTTP/1.1 HOST:myhost.com HTTP/1.1 302 Found Date: Mon, 27 Mar 2017 20:25:27 GMT Server: Apache Vary: Host,Accept-Encoding P3P: CP="IDC DSP COR CURa ADMa OUR IND PHY ONL COM STA" Location: / Set-Cookie: [cut here] Content-Type: text/html; charset=utf-8 Edited March 27, 2017 by renton4 (see edit history) Link to comment Share on other sites More sharing options...
jetway Posted March 29, 2017 Share Posted March 29, 2017 Did you block the bot? Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now