Odoo Help

Welcome!

This community is for beginners and experts willing to share their Odoo knowledge. It's not a forum to discuss ideas, but a knowledge base of questions and their answers.

4

What is the best method to upload a large quantity of records?

By
paul
on 3/19/13, 9:08 AM 2,201 views

What is the best method to upload a large quantity of records in version 7 on windows?

Overview:

  • I have ~500,000 new product records to upload
  • I have attempted the upload using the csv import process
  • But the application fails to complete the upload after providing the following status messages:
    • Loading
    • Still loading...be patient
    • Don't leave yet, it's still loading
    • You may not believe it, but the application is actually loading...
    • Take a minute to get a coffee, because it's loading
    • Maybe you should consider reloading the application by pressing F5...

Notes:

  • uploading smaller chunks of records is obviously doable but not very efficient
  • I let the process run over 12 hours

I don't know the speed of your machine, but I made a python script to read a CSV-file and use the openERP framework to import the data. This way, I know it is correctly imported and the triggers are processed. Maybe you can do the same thing on your machine. I do not know anything about the speed. Advantage of script is you can do additional checking (like line has been imported), so you can keep running the script if it fails during execution (for whatever reason).

patrick
on 3/19/13, 12:52 PM
0
tlauber
On 3/20/13, 5:31 AM

We used Talend Open Studio to build a job which directly writes the database.

0

Gustavo

--Gustavo--
950
| 2 1 4
Buenos Aires, Argentina
--Gustavo--

Python developer, big fan of sailing

Gustavo
On 3/19/13, 6:17 PM

Another option is to upload the records with a Python script and web-services

0

Kevin McMenamin

--Kevin McMenamin--
804
| 5 2 6
Auckland, New Zealand
--Kevin McMenamin--
Kevin McMenamin
On 3/19/13, 5:47 PM

we have used Pentaho as the ETL tool - loaded over 1M account_move_line records successfully.

Your Answer

Please try to give a substantial answer. If you wanted to comment on the question or answer, just use the commenting tool. Please remember that you can always revise your answers - no need to answer the same question twice. Also, please don't forget to vote - it really helps to select the best questions and answers!

About This Community

This community is for professionals and enthusiasts of our products and services. Read Guidelines

Question tools

2 follower(s)

Stats

Asked: 3/19/13, 9:08 AM
Seen: 2201 times
Last updated: 3/16/15, 8:10 AM