This question has been flagged
4 Replies
6831 Views

 Hi

I try to import data from a csv file but it's seem that it's impossible to import more than 400 lines.

How can i avoid this ?

Thanks for your help

Avatar
Discard

What does 'impossible' mean? Do you get an error message? Something else?

Sure You can import 400 lines, but from my experience, more than 5.000 at once is a bad idea, the process will take forever

I tried 400 records and it worked in 10 minutes, tried 1700 and it took forever! So I had to terminate it after an hour waiting and then imported directly to database.

Today, on a dual core 8GB server, I imported three files of 5,000 items each in 25 seconds per file with regular timeout from nginx. It depends on what you are importing - which model - and how many fields.

Best Answer

Check if you have a reverse proxy like nginx. It ussually makes timeout before the operation is complete. I disable reverse proxy before uploading large data files.  

Avatar
Discard