uvip Posted October 20, 2014 Share Posted October 20, 2014 Our site is cloned and Mirrored by some competitors by HTTrack Website Copier, we are wondering how can prevent such mirror and clone? Anyone can advise? Thanks Link to comment Share on other sites More sharing options...
parsifal Posted October 20, 2014 Share Posted October 20, 2014 I guess you determined it's HTTrack by checking your access logs, right? If so, this means that they are running HTTrack with its default user agent string and you could use this to your advantage by blocking them at the web server level. For example, if your website runs under the popular Apache web server, you could try the .htaccess method: http://www.javascriptkit.com/howto/htaccess13.shtml Other web servers (nginx, lighttpd etc) should also have similar methods to block a known user agent. 1 Link to comment Share on other sites More sharing options...
uvip Posted October 20, 2014 Author Share Posted October 20, 2014 On 10/20/2014 at 7:18 AM, parsifal said: I guess you determined it's HTTrack by checking your access logs, right? If so, this means that they are running HTTrack with its default user agent string and you could use this to your advantage by blocking them at the web server level. For example, if your website runs under the popular Apache web server, you could try the .htaccess method: http://www.javascriptkit.com/howto/htaccess13.shtml Other web servers (nginx, lighttpd etc) should also have similar methods to block a known user agent. Thanks for your information. Since they mirrored our site, and we are not able to stop their server, is there a way to block the current mirror? Also this mirror caused all our google rankings gone, so anyway to get our rankings back quickly? Thanks Link to comment Share on other sites More sharing options...
uvip Posted October 20, 2014 Author Share Posted October 20, 2014 On 10/20/2014 at 7:18 AM, parsifal said: I guess you determined it's HTTrack by checking your access logs, right? If so, this means that they are running HTTrack with its default user agent string and you could use this to your advantage by blocking them at the web server level. For example, if your website runs under the popular Apache web server, you could try the .htaccess method: http://www.javascriptkit.com/howto/htaccess13.shtml Other web servers (nginx, lighttpd etc) should also have similar methods to block a known user agent. Also, I am wondering if we put our site on cloudflare, then there is no need to add these codings since cloudflare do detect bots and block them? Please help advise. Thanks Link to comment Share on other sites More sharing options...
uvip Posted October 29, 2014 Author Share Posted October 29, 2014 On 10/20/2014 at 7:18 AM, parsifal said: I guess you determined it's HTTrack by checking your access logs, right? If so, this means that they are running HTTrack with its default user agent string and you could use this to your advantage by blocking them at the web server level. For example, if your website runs under the popular Apache web server, you could try the .htaccess method: http://www.javascriptkit.com/howto/htaccess13.shtml Other web servers (nginx, lighttpd etc) should also have similar methods to block a known user agent. I am wondering if there is any good tool to monitor the mirror site since we have already let the domain to shut down the site. However, the hacker just blocked all the ips for visiting and we believe he still got our data there so we want to know if there is a tool to 24/7 monitor the site and we can get an alert asap when he opened the site again for visiting. Also, is there a tool to monitor other potential mirror sites for future cautions? So that we can take actions immediately after the quick detection. Thanks a lot for your help there! And anyone has a suggestion, please help share it here. Thanks Link to comment Share on other sites More sharing options...
parsifal Posted October 30, 2014 Share Posted October 30, 2014 (edited) On 10/29/2014 at 2:59 PM, uvip said: I am wondering if there is any good tool to monitor the mirror site since we have already let the domain to shut down the site. However, the hacker just blocked all the ips for visiting and we believe he still got our data there so we want to know if there is a tool to 24/7 monitor the site and we can get an alert asap when he opened the site again for visiting. Pingdom is a quite popular online service for this kind of task. You can try it with a free account and decide for yourself if it suits your needs. Edited October 30, 2014 by parsifal (see edit history) Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now