Community mailing list archives

community@mail.odoo.com

Re: mass importing partners. whats the best way?

by
Laurent Mignon - Senior Software Engineer, Acsone
- 09/10/2015 08:22:56
You can also use base_import_async (https://apps.openerp.com/apps/modules/8.0/base_import_async/) from OCA https://github.com/OCA/connector-interfaces.git#8.0
This module extends the standard CSV import functionality to import files in the background using the OCA/connector framework. 

On Thu, Sep 10, 2015 at 1:17 PM, Alexandre Fayolle <alexandre.fayolle@camptocamp.com> wrote:
On 10/09/2015 12:07, robert wrote:
> Hi there,
> 
> I would like to import some 60'000 partners from a foreign (mysql) database.
> I tried to import them from a csv file.
> But this just seems next to impossible in one single lifetime ..
> 
> Now my questions:
> what is the best way do do so?
> I do not mind to write a python script to achieve this.
> However I would be gratefull for a kind of sample on how to do it.

Install base_concurrency which removes a sql level lock which prevents
from parallelizing the import. Then cut your 60k file in 200l files, and
run the import in parallel with N jobs (N being the number of cores on
your server).



-- 
Alexandre Fayolle
Chef de Projet
Tel : +33 4 58 48 20 30

Camptocamp France SAS
Savoie Technolac, BP 352
73377 Le Bourget du Lac Cedex
http://www.camptocamp.com

_______________________________________________
Mailing-List: https://www.odoo.com/groups/community-59
Post to: mailto:community@mail.odoo.com
Unsubscribe: https://www.odoo.com/groups?unsubscribe




--
Laurent Mignon
Senior software engineer

Tel: +352 20 21 10 20 32
Fax: +352 20 21 10 21
Email: laurent.mignon@acsone.eu


Acsone SA, Succursale de Luxembourg 
22, Zone Industrielle
​ ​
​| L-8287 Kehlen, Luxembourg
TVA LU24733605
​ | ​RCS B160400​

Acsone sa/nv
Boulevard de la Woluwe 56, b4  Woluwedal
​ | B-1200 Bruxelles - Brussel 
RPM Bruxelles 0835.207.216 RPR Brussel