Community mailing list archives

Re: mass importing partners. whats the best way?

Camptocamp France SAS, Alexandre Fayolle - Camptocamp
- 09/10/2015 07:15:20
On 10/09/2015 12:07, robert wrote:
> Hi there,
> I would like to import some 60'000 partners from a foreign (mysql) database.
> I tried to import them from a csv file.
> But this just seems next to impossible in one single lifetime ..
> Now my questions:
> what is the best way do do so?
> I do not mind to write a python script to achieve this.
> However I would be gratefull for a kind of sample on how to do it.

Install base_concurrency which removes a sql level lock which prevents
from parallelizing the import. Then cut your 60k file in 200l files, and
run the import in parallel with N jobs (N being the number of cores on
your server).

Alexandre Fayolle
Chef de Projet
Tel : +33 4 58 48 20 30

Camptocamp France SAS
Savoie Technolac, BP 352
73377 Le Bourget du Lac Cedex