Odoo Help

4

What is the best method to upload a large quantity of records?

By
paul
on 3/19/13, 9:08 AM 2,513 views

What is the best method to upload a large quantity of records in version 7 on windows?

Overview:

  • I have ~500,000 new product records to upload
  • I have attempted the upload using the csv import process
  • But the application fails to complete the upload after providing the following status messages:
    • Loading
    • Still loading...be patient
    • Don't leave yet, it's still loading
    • You may not believe it, but the application is actually loading...
    • Take a minute to get a coffee, because it's loading
    • Maybe you should consider reloading the application by pressing F5...

Notes:

  • uploading smaller chunks of records is obviously doable but not very efficient
  • I let the process run over 12 hours

I don't know the speed of your machine, but I made a python script to read a CSV-file and use the openERP framework to import the data. This way, I know it is correctly imported and the triggers are processed. Maybe you can do the same thing on your machine. I do not know anything about the speed. Advantage of script is you can do additional checking (like line has been imported), so you can keep running the script if it fails during execution (for whatever reason).

patrick
on 3/19/13, 12:52 PM
0
tlauber
On 3/20/13, 5:31 AM

We used Talend Open Studio to build a job which directly writes the database.

0
Gustavo
On 3/19/13, 6:17 PM

Another option is to upload the records with a Python script and web-services

0
Kevin McMenamin
On 3/19/13, 5:47 PM

we have used Pentaho as the ETL tool - loaded over 1M account_move_line records successfully.

About This Community

This platform is for beginners and experts willing to share their Odoo knowledge. It's not a forum to discuss ideas, but a knowledge base of questions and their answers.

Register

Odoo Training Center

Access to our E-learning platform and experience all Odoo Apps through learning videos, exercises and Quizz.

Test it now

Question tools

2 follower(s)

Stats

Asked: 3/19/13, 9:08 AM
Seen: 2513 times
Last updated: 3/16/15, 8:10 AM