Skip to Content
This question has been flagged
performanceimportlimitcronjob
4 Replies
4700 Views
Avatar
Benjamin Damour

Hello, 


I'm using the Odoo V15, and I'm stuck on a performance issue problem. I have to run a big import script inside Odoo, and to do this I used the cron from Odoo to allow to schedule the task in background and then run my long script. 

The problem is that the import is very very long (we speak about 2 hours maybe), and I reached the limit_time_real limit, so the task has not the time to finish and I don't get my full import done. 


How could I run this biggest importing task without increasing the limit_time_real value (to my mind it's not the idea here), is there a way to run the script background even if it takes hours to complete ? 


Thank you for your help :)

Avatar
Discard
Avatar
Niyas Raphy (Walnut Software Solutions)
Best Answer

Hi,

You have to change the written script to perform the operation in batch wise. Lets say if you have 10k records to import or update from some where, split it in a batch of 1k records and once it is processed successfully put some marker and exclude it from next batch.

Thanks

Avatar
Discard
Benjamin Damour
Author

Thank you Niyas, I thought about this option, it seems a pretty good idea, but I think that there could be another way (or more optimized), but I agree I think this the only solution, just I have to be sure that even for 1000 it doesn't reach the limit_time_real, at least I will increase it a little bit but not too much.

Avatar
Thuy Ngoc
Best Answer

Hi  Benjamin Damour and Thomas Koliwer,

I think this video can help you: https://www.youtube.com/watch?v=etMYrOJyaiU&list=PLSKcWRTtEl5qzvRaI-VTGavfReiHS_EEb&index=2

Avatar
Discard
Friedrich Sauer

This app costs 1000USD btw

Avatar
Tuan Bui VKS
Best Answer

The module named "VKS Import Excel" can help you solve this problem easily: https://apps.odoo.com/apps/modules/15.0/vks_import_excel.

Please contact me via email anhtuan.acoi@gmail.com if you need further assistance.

Avatar
Discard
Avatar
Dr. Thomas Koliwer
Best Answer

we have also had terrible experiences with large data imports (>70000 items with BOM, >50000 contacts). The scripts sometimes ran for 4-5 hours, then aborted (without error message) and you could start over. I have never experienced something like this with any ERP system...

Avatar
Discard
Related Posts Replies Views Activity
Import csv leads data stops accepting further records...
import limit openerp
Avatar
Avatar
2
Mar 15
8000
Are there limits on how many products can be sold with eCommerce? Solved
performance product limit ecommerce
Avatar
Avatar
1
Oct 24
5579
Import Contact Notes (Help! Which is the correct Odoo Field?) Solved
import
Avatar
Avatar
Avatar
2
Dec 25
226
Importacion de Atributos y Valores
import
Avatar
Avatar
Avatar
Avatar
3
Dec 25
2554
I'm Looking for a real estate Web Design and Development Agency in Dubai
performance
Avatar
5
Dec 25
2265