Community mailing list archives
Re: wkhtmltopdf severe memory leakby
As a future improvement idea, delegating the pdf generation to an async cron job could mitigate this issue.
Report generation queues is something you can find in ERPs like SAP or Oracle Financials.
--DanielThis is what has been caused by wkhtmltopdf on one of our smaller instances (4 GB on Google Cloud).
thanks for this valuable input! On the linked issue, it has been reported that 16GB doesn't cause problems as it is presumably sufficient to buffer this extraordinary consumption. Also what you describe about the limit_memory_hard parameter to 2GB and previous errors could be interpreted as coinciding with the reported increase in memory demand.
I suppose it would be wise to state, that outsourcing wkhtmltopdf to another service is probably a good idea.
If all conclusions are right, then your setup could possibly explode when all 10 odoo workers get increased load from this wkhtmltopdf problem at around the same time, assuming that the memory demand of this malicious wkhtmltopdf process would be more than 16GB This is extremely unlikely, indeed.
Assuming that you are on 0.12.1, this would then indicate that 0.12.1 has the same problem. This also coincides with the issue the wkhtmltopdf maintainer linked in my reported issue, which was going on for 2 years.
Any further reports on this are helpful. Thanks!
as to wkhtmltopdf, iirc: a patched version is required which is satisfied by either 0.12.1 or 0.12.3, yet NOT by 0.12.2Therefore I think, this is a different beast.
In our most recent deployment:
2 Threads per core
4 Cores per socket
1 Socket 1
2,900 Mhz CPU
10 Odoo workers
Initially we ran into occasional error -11 with PDF generation.
After increasing the worker limit_memory_hard parameter to 2GB we have had no further reports of any problems.
For those who don’t know, Odoo recommends 0.12.1 of wkhtmltopdf as documented at https://www.odoo.com/documentation/9.0/setup/install.html
we have experienced the following issue:
In short wkhtml explodes to 1GB+ memory consumption in less then our metrics resolution (2s).
That should worry anyone who runs wkhtmltopdf on the same instance as odoo runs and would kill every averagely scoped server instance under otherwise normal load.
Share your experience with this please!
If I remeber correctly (I'm under way on cellphone):
we are on wkhtmltopdf 0.12.3
the maintainer suggests to try 0.13 alpha
I'll keep you updates once further findings drop in.