Importing CSV infinite 504 Error Crisis

[LockeAG]

Hi everyone..

 

the scenario is this:

 

We try to upload a 28000 csv product file , like 1.8MB splited in 10 files and we always get 504 error

 

I think this is a common error to a very bad Server Configuration o Prestashop Config

 

We use a NGINX+PHP5.5

 

Every damn Timeout conf was increased to 300

 

NGINX   fastcgi_read_timeout 300;

and all PHP + PHP-FPM timeouts a Buffer configuration were extended near the sky 

 

our Server have 16GB RAM and a massive amount o SSD HardDrive....

 

it is odd 'cos in the same server we have a WORDPRESS bigger than our prestashop product DB and this doesn't happen in WP.

 

Can anyone give a hand to detect where is the problem...

 

thanks u

Edited May 6, 2014 by LockeAG (see edit history)

[navid68]

Importing is complicated if you can not test your CSV file. Two simple suggestions:

- test with a small file, just 10 or less products

- test the CSV file without importing images

 

Good luck

Navid

[LockeAG]

Thanks for You answer @navid68 , I tried with 10 products and yeah that do the job , but How I will import 28000 products

 

and I'm not importing any images..

 

thanks!

[Rolige]

For large imports you need use Ajax or cron jobs, PS doesn't use any of this, so, you need split in several files, maybe 5000 products per file, I don't know, you will need to do tests.

[LockeAG]

@COTOKO you said something intersiting AJAX: Is there any plugin that make this possible???

 

and about cron jobs... , you mean make my own query to process this directly in the db??

 

 but could you please guide me in which table to alter....

 

 

thanks

[Rolige]

I guess there are some pay modules out there. With the default system you need split in several files, is the unique option, or maybe someone else has another solution.

[navid68]

@LockeAG yes there are few modules/services but bever found them very usefull: we prepare the CSV in Excel and I found Excel formulas very flexible and easy to change mass data.

 

If you have uploaded 10 products with no errors, then the CSV file is correct: that was the main task for me!!

If you can not upload many products, then it is probably a configuration problem on the server side. I know you can make changes in the php.ini file (or something similar) but I can not help about that.

 

We found a cheap shared host in the UK that lets me import 700-800 products at once (say 70-80% of 1Mb) with no changes in the config. Good price and good service!!

 

Navid

[LockeAG]

Hey just notice that  the issue is with the SSL ,  because is active in the whole site.... but now if deactivate ssl option my site goes blank...

 

and getting 502 errors when trying to import

 

some advice here?

Edited May 8, 2014 by LockeAG (see edit history)