How much data prestashop can handle easily

[sheraz4pro]

Hi, i am working on a project in which i have scraped data from some external site and then insert it in prestashop DB. I have to add 60,000 products in prestashop DB.

But unfortunately, i have only added 2500 products with their images, attributes, and combinations and the site slows down.it is barely loading the home page.

 

i have see prestashop support. The Server meets all the requirements. Please help me and give me some solutions or suggestions to get rid of it.

Edited June 10, 2013 by sheraz4pro (see edit history)

[vekia]

are you sure that:

1. you've got cache option enabled? (preferences > performance)
   
2. force compilation off (preferences > performance)
   

[NemoPS]

It also depends on the platform you run prestashop on. With that amount of products, I'd go for a REALLY good premium shared account, or a VPS. You need tons of memory for 60k products

[vekia]

totally agree with

[sheraz4pro]

thanks for your reply. Yes it is a VPS , prestashop is deployed on it. what else you think can be done ??

[PascalVG]

Seems to be more problems, not just slow. Clicking 'women' takes very long, as you said, but also doesn't load all pictures, only some (as if they time out). Worse, clicking on page 2, 3 etc. gives a 'this page is not available'.

 

How do you add your products? import through csv/different?

(what PS version?)

 

pascal

[todaytonight]

It also depends on the platform you run prestashop on. With that amount of products, I'd go for a REALLY good premium shared account, or a VPS. You need tons of memory for 60k products

 

My shop has approx 200 products only but it is slow also. What is VPS and how much it costs? Thanks

[vekia]

My shop has approx 200 products only but it is slow also. What is VPS and how much it costs? Thanks

 

read more about VPS here: http://www.a2hosting.com/vps-hosting

(this is prestashop partner)

[sheraz4pro]

i am using prestashop 1.5.4.

i have scrapped data from another site and then inserted data in prestashop manually by writing scripts. I have not used csv import because the data will be scrapped on daily bases. i had to automate this thing. so csv import was not a solution.

[sheraz4pro]

I have just echo the query which is being used to get products.

 

SELECT p.*, product_shop.*, product_shop.id_category_default, pl.*, i.id_image, il.legend, m.name manufacturer_name, DATEDIFF(product_shop.`date_add`, DATE_SUB(NOW(), INTERVAL 20 DAY)) > 0 AS new FROM `ps_category_product` cp LEFT JOIN ps_category c ON (c.id_category = cp.id_category) LEFT JOIN `ps_product` p ON p.`id_product` = cp.`id_product` INNER JOIN ps_product_shop product_shop ON (product_shop.id_product = p.id_product AND product_shop.id_shop = 1) LEFT JOIN ps_product_lang pl ON (pl.id_product = p.id_product AND pl.id_shop = 1 ) LEFT JOIN ps_image i ON (i.id_product = p.id_product AND i.cover = 1) LEFT JOIN ps_image_lang il ON (i.id_image = il.id_image AND il.id_lang = 1) LEFT JOIN ps_manufacturer m ON (m.id_manufacturer = p.id_manufacturer) WHERE product_shop.`active` = 1 AND c.nleft >= 3 AND c.nright <= 4 AND c.active = 1 AND pl.id_lang = 1 AND p.id_product IN ( PRODUCTS_IDS )

GROUP BY p.id_product ORDER BY cp.position asc LIMIT 0,20

 

PRODUCT_IDS are comma separated ids.

i am unable to understand the if there are millions of products, then the millions of products ids will be used in the IN clause to filter the products. i think this query is having issues while getting products. this query is in blocklayered module/blocklayered.php file.

this query is being used as i am using block layered navigation module.