Odoo Help

Welcome!

This community is for beginners and experts willing to share their Odoo knowledge. It's not a forum to discuss ideas, but a knowledge base of questions and their answers.

1

is it supposed to take hours to import?

By
Farah pazienza
on 10/22/13, 5:18 PM 939 views

I actived the import option changed the file to csv it let me press import but it tells me to get a cup of coffee.. it has been saying this since 12pm it is now 3pm... what is wrong?

I've seen about 20,000 records an hour get imported. Do you have more than 60,000 ?

Bista Solutions US, Ray Carnes
on 10/22/13, 9:30 PM
0

Brett Lehrer

--Brett Lehrer--
1252
| 5 4 8
Milwaukee, United States
--Brett Lehrer--
Director of IT and open source enthusiast.
Brett Lehrer
On 10/22/13, 9:15 PM

Imports are slow. All of the server code that is necessary to create a new record in the standard interface is run for an import, you're just not loading up pages. I'm guessing offhand you're dealing with a CSV with tens of thousands of records? To make those imports not so painfully slow, you could use software like Talend to help write directly into the postgres database.

What I've been doing is writing up Python scripts to parse a CSV, then reformat the data/headers in a way the database can understand and just use insert statements with psycopg2 (Postgres Python library, used by openerp). Can get data into the database in seconds rather than hours, which means redoing the import to fix an error isn't so painful.

0

Daniel Reis

--Daniel Reis--
3436
| 6 7 9
Lisbon, Portugal
--Daniel Reis--

Author of the "Odoo Development Essentials" book.

Applications Manager at Securitas Portugal

Github: https://github.com/dreispt

Twitter; @reis_pt


Daniel Reis
On 10/23/13, 6:35 AM

Your import is slow if it handles 10 record per second; worst case scenario it shouldn't take longer than 1 record per second. It it does, something's wrong:

  • try with a small sample of record, just to confirm that it's not slowness.
  • have a look at the server log: there might be an error that not being passed on to the user interface, but is blocking the import.

When I tried importing about 1100 products, it took a very consistent 7 minutes and 50 seconds, +/- 2 seconds, and that was with no errors. About 0.43 seconds to import a single record. Once you scale that up, it takes an hour to import less than 10,000 records.

Brett Lehrer
on 10/23/13, 12:19 PM

Your Answer

Please try to give a substantial answer. If you wanted to comment on the question or answer, just use the commenting tool. Please remember that you can always revise your answers - no need to answer the same question twice. Also, please don't forget to vote - it really helps to select the best questions and answers!

About This Community

This community is for professionals and enthusiasts of our products and services. Read Guidelines

Question tools

0 follower(s)

Stats

Asked: 10/22/13, 5:18 PM
Seen: 939 times
Last updated: 3/16/15, 8:10 AM