Community mailing list archives

Re: mass importing partners. whats the best way?

Houssine BAKKALI
- 09/10/2015 08:24:46
you could also use this module for this

2015-09-10 13:17 GMT+02:00 Alexandre Fayolle <>:
On 10/09/2015 12:07, robert wrote:
> Hi there,
> I would like to import some 60'000 partners from a foreign (mysql) database.
> I tried to import them from a csv file.
> But this just seems next to impossible in one single lifetime ..
> Now my questions:
> what is the best way do do so?
> I do not mind to write a python script to achieve this.
> However I would be gratefull for a kind of sample on how to do it.

Install base_concurrency which removes a sql level lock which prevents
from parallelizing the import. Then cut your 60k file in 200l files, and
run the import in parallel with N jobs (N being the number of cores on
your server).

Alexandre Fayolle
Chef de Projet
Tel : +33 4 58 48 20 30

Camptocamp France SAS
Savoie Technolac, BP 352
73377 Le Bourget du Lac Cedex

Post to: