Odoo is the world's easiest all-in-one management software.
It includes hundreds of business apps:

ลูกค้าสัมพันธ์
e-Commerce
ระบบบัญชี
สินค้าคงคลัง
PoS
โปรเจกต์
MRP

All apps

All Posts คน เหรียญรางวัล

แท็ก (View all)

odoo accounting v14 pos v15

เกี่ยวกับฟอรั่มนี้

ช่วยเหลือ

Odoo payroll multiprocessing to speed it up

payroll multiprocess odoo

1 ตอบกลับ

5589 มุมมอง

AteneoLab

Hi every one, I need to execute a payroll for more than 6K employees. This takes about 4 hours to complete.

I want to parallelize the method that compute and confirms the payroll but it throws this error message:

Traceback (most recent call last):

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 654, in _handle_exception

return super(JsonRequest, self)._handle_exception(exception)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 312, in _handle_exception

raise pycompat.reraise(type(exception), exception, sys.exc_info()[2])

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/tools/pycompat.py", line 87, in reraise

raise value

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 696, in dispatch

result = self._call_function(**self.params)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 344, in _call_function

return checked_call(self.db, *args, **kwargs)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/service/model.py", line 97, in wrapper

return f(dbname, *args, **kwargs)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 337, in checked_call

result = self.endpoint(*a, **kw)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 939, in __call__

return self.method(*args, **kw)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/http.py", line 517, in response_wrap

response = f(*args, **kw)

File "/home/matos/PycharmProjects/Odoo12/odoo/addons/web/controllers/main.py", line 966, in call_button

action = self._call_kw(model, method, args, {})

File "/home/matos/PycharmProjects/Odoo12/odoo/addons/web/controllers/main.py", line 954, in _call_kw

return call_kw(request.env[model], method, args, kwargs)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/api.py", line 749, in call_kw

return _call_kw_multi(method, model, args, kwargs)

File "/home/matos/PycharmProjects/Odoo12/odoo/odoo/api.py", line 736, in _call_kw_multi

result = method(recs, *args, **kwargs)

File "/home/matos/PycharmProjects/Odoo12/payroll/payroll_masive/models/payslip_run.py", line 70, in compute_and_confirm_sheet_massive

pool.map(self.excec, [slip for slip in slip_list_par])

File "/usr/lib/python3.6/multiprocessing/pool.py", line 288, in map

return self._map_async(func, iterable, mapstar, chunksize).get()

File "/usr/lib/python3.6/multiprocessing/pool.py", line 670, in get

raise self._value

File "/usr/lib/python3.6/multiprocessing/pool.py", line 450, in _handle_tasks

put(task)

File "/usr/lib/python3.6/multiprocessing/connection.py", line 206, in send

self._send_bytes(_ForkingPickler.dumps(obj))

File "/usr/lib/python3.6/multiprocessing/reduction.py", line 51, in dumps

cls(buf, protocol).dump(obj)

_pickle.PicklingError: Can't pickle <class 'odoo.api.hr.payslip.run'>: attribute lookup hr.payslip.run on odoo.api failed

Does anyone of you have any idea of why is this and how to solve it?

Thank you very much.

djking7

you can't pickle odoo methods, you need to send table of ids to the function declared outside of the class;

Example:

def multi_compute(ids)

kwargs = {'uid': request.uid, 'db': request.db}
with openerp.api.Environment.manage():
    with openerp.registry(kwargs.get('db')).cursor() as new_cr:
        env = openerp.api.Environment(new_cr, kwargs.get('uid'), {})

      playslip_obj = env['hr.payslip']

      payslip_ids = payslip_obj.browse(ids).compute_sheet()

the call of the method with multiprocessing library should be like this:

list = list(split([slip for slip in slip_list_par], multiprocessing.cpu_count()))

try:
    pool = multiprocessing.Pool(multiprocessing.cpu_count())
    pool.map(multi_compute, list)
except KeyboardInterrupt, e:
    pool.terminate()
    raise e

if you get any connection problem add try and except to 'multi_compute' function

and in the exception recall the method again ('multi_compute(ids)') cause sometimes it's blocked by postgress

cause another process is blocking you process, so you need to recall it after a time

I hope this helps

สนุกกับการพูดคุยนี้ใช่ไหม? เข้าร่วมเลย!

สร้างบัญชีวันนี้เพื่อเพลิดเพลินไปกับฟีเจอร์พิเศษและมีส่วนร่วมกับคอมมูนิตี้ที่ยอดเยี่ยมของเรา!

ลงชื่อ

Related Posts	ตอบกลับ	มุมมอง
How to implement a salary rule for an employee with "Agency Contract"? payroll odoo	0 มี.ค. 17	4873
I can't register payment when doing payroll as I did not add a bank account payroll odoo v17	1 ก.พ. 24	96
Wrong python condition defined for salary rule แก้ไขแล้ว python payroll odoo	2 ธ.ค. 22	8888
Cannot update missing record แก้ไขแล้ว error payroll odoo	1 เม.ย. 21	6199
Odoo set default currency for payroll แก้ไขแล้ว payroll currency odoo	1 ม.ค. 20	5099

คำถามนี้ถูกตั้งค่าสถานะ

สนุกกับการพูดคุยนี้ใช่ไหม? เข้าร่วมเลย!