Ray UK Posted March 14 Share Posted March 14 (edited) Out of 1047 visitors online, 773 are of the same IP address 20.171.207.144 A reverse lookup points to Microsoft. Its been like this for a while now. Is there something wrong here or is MS just being very nosey Edited March 14 by Ray UK (see edit history) 1 Link to comment Share on other sites More sharing options...
Prestashop Addict Posted March 14 Share Posted March 14 May be a bot or bing crawler Link to comment Share on other sites More sharing options...
Ray UK Posted March 14 Author Share Posted March 14 On 3/14/2025 at 12:29 PM, Prestashop Addict said: May be a bot or bing crawler Expand I thought that with is pointing to MS, but its been like that a few days constantly and the DB gets much bigger because of all the traffic. Ive blocked it and see what happens Link to comment Share on other sites More sharing options...
WisQQ Posted March 14 Share Posted March 14 It's a bad bot trying to crawl your page ignoring robot.txt, if they drain your resources just block them. You can check logs on your server and see if they are sending you HEAD requests, usually first they try to check it they have access to the page after that they proceed with crawling. Link to comment Share on other sites More sharing options...
Knowband Plugins Posted March 15 Share Posted March 15 What is the user agent in the server access log against the IP? This report shows its a bad bot, but Ithe P is related to Microsoft, not Azure, so I'm not sure if its bad bod OR not. https://www.abuseipdb.com/check/20.171.207.144 Link to comment Share on other sites More sharing options...
QuickUpdate.net Posted March 15 Share Posted March 15 (edited) Most probably bing bot Edited March 15 by QuickUpdate.net (see edit history) Link to comment Share on other sites More sharing options...
Ray UK Posted March 16 Author Share Posted March 16 (edited) OK, so ive blocked that ip address and the connections have dropped a lot, but there are still a few hundred of another IP. anyhow, ive found the db table that is growing. ps_layered_filter_block is currently 2.4Gb so Ive just gone into the faceted search module and cleared the cache (The DB size dropped down to 38Mb) The data in the "data" column was like this a:1:{s:7:"filters";a:4:{i:0;a:7:{s:9:"type_lite";s:12:"manufacturer";s:4:"type";s:12:"manufacturer";s:6:"id_key";i:0;s:4:"name";s:5:"Brand";s:6:"values";a:6:{i:5;a:2:{s:4:"name";s:5:"I.V.G";s:3:"nbr";s:1:"1";}i:22;a:2:{s:4:"name";s:10:"Just Juice";s:3:"nbr";s:1:"3";}i:23;a:2:{s:4:"name";s:12:"Vampire Vape";s:3:"nbr";s:1:"4";}i:29;a:2:{s:4:"name";s:11:"Dinner Lady";s:3:"nbr";s:1:"3";}i:34;a:2:{s:4:"name";s:10:"Refill Bar";s:3:"nbr";s:1:"2";}i:35;a:2:{s:4:"name";s:14:"Britannia Gold";s:3:"nbr";s:1:"5";}}s:17:"filter_show_limit";i:0;s:11:"filter_type";s:1:"0";}i:1;a:9:{s:9:"type_lite";s:10:"id_feature";s:4:"type";s:10:"id_feature";s:6:"id_key";s:1:"3";s:6:"values";a:1:{i:11;a:4:{s:3:"nbr";s:2:"18";s:4:"name";s:4:"10ml";s:8:"url_name";N;s:10:"meta_title";N;}}s:4:"name";s:8:"Capacity";s:8:"url_name";N;s:10:"meta_title";N;s:17:"filter_show_limit";i:0;s:11:"filter_type";s:1:"0";}i:2;a:9:{s:9:"type_lite";s:10:"id_feature";s:4:"type";s:10:"id_feature";s:6:"id_key";s:2:"21";s:6:"values";a:49:{i:2844;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:7:"Aniseed";s:8:"url_name";N;s:10:"meta_title";N;}i:2848;a:4:{s:3:"nbr";s:1:"5";s:4:"name";s:5:"Apple";s:8:"url_name";N;s:10:"meta_title";N;}i:2847;a:4:{s:3:"nbr";s:1:"2";s:4:"name";s:6:"Banana";s:8:"url_name";N;s:10:"meta_title";N;}i:2877;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:7:"Biscuit";s:8:"url_name";N;s:10:"meta_title";N;}i:2843;a:4:{s:3:"nbr";s:1:"5";s:4:"name";s:12:"Blackcurrant";s:8:"url_name";N;s:10:"meta_title";N;}i:2805;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:9:"Blueberry";s:8:"url_name";N;s:10:"meta_title";N;}i:2853;a:4:{s:3:"nbr";s:1:"5";s:4:"name";s:9:"Bubblegum";s:8:"url_name";N;s:10:"meta_title";N;}i:2873;a:4:{s:3:"nbr";s:1:"4";s:4:"name";s:5:"Candy";s:8:"url_name";N;s:10:"meta_title";N;}i:2812;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:7:"Caramel";s:8:"url_name";N;s:10:"meta_title";N;}i:2876;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:6:"Cereal";s:8:"url_name";N;s:10:"meta_title";N;}i:2872;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:10:"Cheesecake";s:8:"url_name";N;s:10:"meta_title";N;}i:2797;a:4:{s:3:"nbr";s:1:"9";s:4:"name";s:6:"Cherry";s:8:"url_name";N;s:10:"meta_title";N;}i:2866;a:4:{s:3:"nbr";s:1:"2";s:4:"name";s:6:"Citrus";s:8:"url_name";N;s:10:"meta_title";N;}i:2864;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:7:"Coconut";s:8:"url_name";N;s:10:"meta_title";N;}i:2857;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:6:"Coffee";s:8:"url_name";N;s:10:"meta_title";N;}i:2798;a:4:{s:3:"nbr";s:1:"2";s:4:"name";s:4:"Cola";s:8:"url_name";N;s:10:"meta_title";N;}i:2863;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:9:"Cranberry";s:8:"url_name";N;s:10:"meta_title";N;}i:2871;a:5:{s:3:"nbr";s:1:"3";s:4:"name";s:7:"Custard";s:8:"url_name";N;s:10:"meta_title";N;s:7:"checked";b:1;}i:2855;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:12:"Energy Drink";s:8:"url_name";N;s:10:"meta_title";N;}i:2860;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:5:"Grape";s:8:"url_name";N;s:10:"meta_title";N;}i:2865;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:5:"Guava";s:8:"url_name";N;s:10:"meta_title";N;}i:2799;a:4:{s:3:"nbr";s:2:"16";s:4:"name";s:3:"Ice";s:8:"url_name";N;s:10:"meta_title";N;}i:2852;a:4:{s:3:"nbr";s:1:"2";s:4:"name";s:4:"Kiwi";s:8:"url_name";N;s:10:"meta_title";N;}i:2861;a:4:{s:3:"nbr";s:1:"4";s:4:"name";s:5:"Lemon";s:8:"url_name";N;s:10:"meta_title";N;}i:2796;a:4:{s:3:"nbr";s:1:"5";s:4:"name";s:8:"Lemonade";s:8:"url_name";N;s:10:"meta_title";N;}i:2800;a:4:{s:3:"nbr";s:1:"6";s:4:"name";s:4:"Lime";s:8:"url_name";N;s:10:"meta_title";N;}i:2850;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:9:"Liquorice";s:8:"url_name";N;s:10:"meta_title";N;}i:2807;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:5:"Mango";s:8:"url_name";N;s:10:"meta_title";N;}i:2875;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:11:"Marshmallow";s:8:"url_name";N;s:10:"meta_title";N;}i:2859;a:5:{s:3:"nbr";s:1:"6";s:4:"name";s:7:"Menthol";s:8:"url_name";N;s:10:"meta_title";N;s:7:"checked";b:1;}i:2858;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:4:"Milk";s:8:"url_name";N;s:10:"meta_title";N;}i:2803;a:4:{s:3:"nbr";s:1:"6";s:4:"name";s:4:"Mint";s:8:"url_name";N;s:10:"meta_title";N;}i:2795;a:4:{s:3:"nbr";s:1:"8";s:4:"name";s:13:"Mixed Berries";s:8:"url_name";N;s:10:"meta_title";N;}i:3025;a:4:{s:3:"nbr";s:1:"5";s:4:"name";s:12:"Mixed Fruits";s:8:"url_name";N;s:10:"meta_title";N;}i:2814;a:4:{s:3:"nbr";s:1:"2";s:4:"name";s:4:"Nuts";s:8:"url_name";N;s:10:"meta_title";N;}i:2845;a:4:{s:3:"nbr";s:1:"2";s:4:"name";s:6:"Orange";s:8:"url_name";N;s:10:"meta_title";N;}i:2809;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:6:"Papaya";s:8:"url_name";N;s:10:"meta_title";N;}i:2854;a:4:{s:3:"nbr";s:1:"4";s:4:"name";s:13:"Passion Fruit";s:8:"url_name";N;s:10:"meta_title";N;}i:2801;a:4:{s:3:"nbr";s:1:"4";s:4:"name";s:5:"Peach";s:8:"url_name";N;s:10:"meta_title";N;}i:2849;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:4:"Pear";s:8:"url_name";N;s:10:"meta_title";N;}i:2808;a:4:{s:3:"nbr";s:1:"4";s:4:"name";s:9:"Pineapple";s:8:"url_name";N;s:10:"meta_title";N;}i:2856;a:4:{s:3:"nbr";s:1:"7";s:4:"name";s:9:"Raspberry";s:8:"url_name";N;s:10:"meta_title";N;}i:2802;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:4:"Soda";s:8:"url_name";N;s:10:"meta_title";N;}i:2851;a:4:{s:3:"nbr";s:1:"6";s:4:"name";s:10:"Strawberry";s:8:"url_name";N;s:10:"meta_title";N;}i:2867;a:4:{s:3:"nbr";s:1:"4";s:4:"name";s:4:"Tart";s:8:"url_name";N;s:10:"meta_title";N;}i:2810;a:5:{s:3:"nbr";s:1:"9";s:4:"name";s:7:"Tobacco";s:8:"url_name";N;s:10:"meta_title";N;s:7:"checked";b:1;}i:2813;a:4:{s:3:"nbr";s:1:"1";s:4:"name";s:6:"Toffee";s:8:"url_name";N;s:10:"meta_title";N;}i:2811;a:4:{s:3:"nbr";s:1:"5";s:4:"name";s:7:"Vanilla";s:8:"url_name";N;s:10:"meta_title";N;}i:2846;a:4:{s:3:"nbr";s:1:"3";s:4:"name";s:10:"Watermelon";s:8:"url_name";N;s:10:"meta_title";N;}}s:4:"name";s:15:"Flavour Profile";s:8:"url_name";N;s:10:"meta_title";N;s:17:"filter_show_limit";i:0;s:11:"filter_type";s:1:"0";}i:3;a:9:{s:9:"type_lite";s:10:"id_feature";s:4:"type";s:10:"id_feature";s:6:"id_key";s:2:"18";s:6:"values";a:2:{i:2508;a:4:{s:3:"nbr";s:2:"12";s:4:"name";s:8:"Freebase";s:8:"url_name";N;s:10:"meta_title";N;}i:2509;a:4:{s:3:"nbr";s:1:"6";s:4:"name";s:4:"Salt";s:8:"url_name";N;s:10:"meta_title";N;}}s:4:"name";s:13:"Nicotine Type";s:8:"url_name";N;s:10:"meta_title";N;s:17:"filter_show_limit";i:0;s:11:"filter_type";s:1:"0";}}} Im presuming thats just the cache, but why is it caching so many times ( there we over 100k entries before I cleared it ) Edited March 16 by Ray UK (see edit history) Link to comment Share on other sites More sharing options...
El Patron Posted March 17 Share Posted March 17 consider adding a cron job daily to clear the cache, we use amazzing filters which has cron link to add, here are instuctions from faceted search for ps 8.1.2 We recommend to set regular cron tasks to manage the indexes and cache on daily/weekly basis. Flush block cache: https://prestashop812.demosprestaheroes.guru/module/ps_facetedsearch/cron?ajax=1&action=clearCache&token=(your token we have been impressed with https://sucuri.net/ and this is becoming very popular with major websites https://www.cloudflare.com/application-services/products/turnstile/ happy selling Link to comment Share on other sites More sharing options...
Prestashop Addict Posted March 17 Share Posted March 17 I don't really understand why keeping "Visitors online", "Pages not found" and "Data mining for statistics" modules, they keep so many data in database and growing fast as the traffic grows! And it's redundant with tools like Google Analytics or service like. We saw many shops with databases with gigabytes due to those modules. When you remove them and truncate tables, databases come back most of the time < 256Mb! It's important to keep the database small as possible for performances. Link to comment Share on other sites More sharing options...
Ray UK Posted March 17 Author Share Posted March 17 On 3/17/2025 at 4:18 PM, El Patron said: consider adding a cron job daily to clear the cache, we use amazzing filters which has cron link to add, here are instuctions from faceted search for ps 8.1.2 We recommend to set regular cron tasks to manage the indexes and cache on daily/weekly basis. Flush block cache: https://prestashop812.demosprestaheroes.guru/module/ps_facetedsearch/cron?ajax=1&action=clearCache&token=(your token we have been impressed with https://sucuri.net/ and this is becoming very popular with major websites https://www.cloudflare.com/application-services/products/turnstile/ happy selling Expand Ive never managed to get the CRON working. Ive tried it on my WHM and Cpanel and neither seem to work. do we put the URL as /module/ps_facetedsearch/cron?ajax=1&action=clearCache&token= or put the URL as /modules/ps_facetedsearch/cron?ajax=1&action=clearCache&token= ? The faceted search modules says /module/ but in my file manager that folder doesnt exist, it has always been /modules/ Ive emptied the tables in the DB, and also cleared all the connection info in the DB and its reduced my DB from over 2Gb to 19.7Mb so Ive left the faceted search cache turned off for now. Link to comment Share on other sites More sharing options...
musicmaster Posted March 18 Share Posted March 18 Prestashop is programmed so that bots are not stored in the ps_connections table. There is a list of bots that it checks for in the file /classes/connection.php in the function isBot. However, it looks like the list is outdated so that many bots get into the table anyway. 1 Link to comment Share on other sites More sharing options...
Knowband Plugins Posted March 19 Share Posted March 19 On 3/17/2025 at 9:01 PM, Ray UK said: do we put the URL as /module/ps_facetedsearch/cron?ajax=1&action=clearCache&token= Expand This is the correct URL. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now