Skip to Content
Odoo Meniu
  • Autentificare
  • Try it free
  • Aplicații
    Finanțe
    • Contabilitate
    • Facturare
    • Cheltuieli
    • Spreadsheet (BI)
    • Documente
    • Semn
    Vânzări
    • CRM
    • Vânzări
    • POS Shop
    • POS Restaurant
    • Abonamente
    • Închiriere
    Site-uri web
    • Constructor de site-uri
    • eCommerce
    • Blog
    • Forum
    • Live Chat
    • eLearning
    Lanț Aprovizionare
    • Inventar
    • Producție
    • PLM
    • Achiziție
    • Maintenance
    • Calitate
    Resurse Umane
    • Angajați
    • Recrutare
    • Time Off
    • Evaluări
    • Referințe
    • Flotă
    Marketing
    • Social Marketing
    • Marketing prin email
    • SMS Marketing
    • Evenimente
    • Automatizare marketing
    • Sondaje
    Servicii
    • Proiect
    • Foi de pontaj
    • Servicii de teren
    • Centru de asistență
    • Planificare
    • Programări
    Productivitate
    • Discuss
    • Aprobări
    • IoT
    • VoIP
    • Knowledge
    • WhatsApp
    Aplicații Terțe Odoo Studio Platforma Odoo Cloud
  • Industrii
    Retail
    • Book Store
    • Magazin de îmbrăcăminte
    • Magazin de Mobilă
    • Magazin alimentar
    • Magazin de materiale de construcții
    • Magazin de jucării
    Food & Hospitality
    • Bar and Pub
    • Restaurant
    • Fast Food
    • Guest House
    • Distribuitor de băuturi
    • Hotel
    Proprietate imobiliara
    • Real Estate Agency
    • Firmă de Arhitectură
    • Construcție
    • Estate Managament
    • Grădinărit
    • Asociația Proprietarilor de Proprietăți
    Consultanta
    • Firma de Contabilitate
    • Partener Odoo
    • Agenție de marketing
    • Law firm
    • Atragere de talente
    • Audit & Certification
    Producție
    • Textil
    • Metal
    • Mobilier
    • Mâncare
    • Brewery
    • Cadouri corporate
    Health & Fitness
    • Club Sportiv
    • Magazin de ochelari
    • Centru de Fitness
    • Wellness Practitioners
    • Farmacie
    • Salon de coafură
    Trades
    • Handyman
    • IT Hardware and Support
    • Asigurare socială de stat
    • Cizmar
    • Servicii de curățenie
    • HVAC Services
    Altele
    • Organizație nonprofit
    • Agenție de Mediu
    • Închiriere panouri publicitare
    • Fotografie
    • Închiriere biciclete
    • Asigurare socială
    Browse all Industries
  • Comunitate
    Învăță
    • Tutorials
    • Documentație
    • Certificări
    • Instruire
    • Blog
    • Podcast
    Empower Education
    • Program Educațional
    • Scale Up! Business Game
    • Visit Odoo
    Obține Software-ul
    • Descărcare
    • Compară Edițiile
    • Lansări
    Colaborați
    • Github
    • Forum
    • Evenimente
    • Translations
    • Devino Partener
    • Services for Partners
    • Înregistrează-ți Firma de Contabilitate
    Obține Servicii
    • Găsește un Partener
    • Găsiți un contabil
    • Meet an advisor
    • Servicii de Implementare
    • Referințe ale clienților
    • Suport
    • Actualizări
    Github Youtube Twitter Linkedin Instagram Facebook Spotify
    +1 (650) 691-3277
    Obține un demo
  • Prețuri
  • Ajutor

Odoo is the world's easiest all-in-one management software.
It includes hundreds of business apps:

  • CRM
  • e-Commerce
  • Contabilitate
  • Inventar
  • PoS
  • Proiect
  • MRP
All apps
Trebuie să fiți înregistrat pentru a interacționa cu comunitatea.
All Posts Oameni Insigne
Etichete (View all)
odoo accounting v14 pos v15
Despre acest forum
Trebuie să fiți înregistrat pentru a interacționa cu comunitatea.
All Posts Oameni Insigne
Etichete (View all)
odoo accounting v14 pos v15
Despre acest forum
Suport

high volume of data failed to generate report

Abonare

Primiți o notificare când există activitate la acestă postare

Această întrebare a fost marcată
postgresvolumehightuning
4 Răspunsuri
9178 Vizualizări
Imagine profil
Akhmad Daniel Sembiring

hi All,

Currently we have around 350,000 lines of account_move_line and 60,000 lines of account_move, and it;s increasing shortly. Those records belongs to a single partner.

my OpenERP system was failed just to generate "General Ledger" and "Partner Ledger" report from all those records. the browser is just displaying loading message with no end. All other simple reports with only few pages of PDF are fine.

my server has 6GB of RAM, 12 cores CPU, running CentOS 6 linux.

i have done openerp, postgresql and linux kernel tuning as follows:

Linux:

kernel.shmmax = 68719476739
kernel.shmall = 16777216
kernel.shmmni = 4096

Postgres:

shared_buffers = 4GB  
temp_buffers = 500MB
default_statistics_target = 100
maintenance_work_mem = 480MB
checkpoint_completion_target = 0.9
effective_cache_size = 6GB
work_mem = 50MB
wal_buffers = 16MB
checkpoint_segments = 64

OpenERP:

workers = 25
limit_request = 100000
osv_memory_age_limit = 1.0
limit_time_real = 240
limit_time_cpu = 600
limit_memory_hard = 6442450944
limit_memory_soft = 3221225472

but still no luck generating those reports. any help or clue will be very appreciated

thanks

1
Imagine profil
Abandonează
Imagine profil
Jagadish
Cel mai bun răspuns

Developer can try to get big data like more than 160000 lines in xlsx report 
Using controllers Get data (To get Data Use Query) and prepare or arrange the data using 

call controllers from python or JS 

import io
import xlsxwriter


 finally close the workbook and 
change the arranged data has like bytes 

output = io.BytesIO() 
workbook = xlsxwriter.Workbook(output, {'in_memory': True})
worksheet = workbook.add_worksheet()

workbook.close()
output.seek(0)
return output.getvalue()

and In controllers return make_response as


@http.route('/big_data_xlsx_report', type='http', auth='user', methods=['POST'], csrf=False) 
def get_report_xlsx(self, model, output_format, report_data, report_name, **kw):
uid = request.session.uid
report_obj = request.env[model].with_user(uid)
load_data = json.loads(report_data)
try:
if output_format == 'xlsx':
cell_data = report_obj.get_report_data(load_data)
report_bytes = report_obj.prepare_report(call_data)
response = request.make_response(
report_bytes,
headers=[
('Content-Type', 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet'),
('Content-Disposition', content_disposition(report_name + '.xlsx'))
]
)
response.set_cookie('fileToken', 'dummy-because-api-expects-one')
return response
except Exception as e:
se = _serialize_exception(e)
error = {
'code': 200,
'message': 'Odoo Server Error',
'data': se
}
return request.make_response(html_escape(json.dumps(error)))

with fraction of seconds user can get big data in report





0
Imagine profil
Abandonează
Imagine profil
sraps
Cel mai bun răspuns

For high volume reporting tasks you should use Aeroo Reports and it's support for deferred tasks. Original reports are usable only with low volume data. Even if normally report would time out, if report is run as a deferred process, it would create background task. Once completed it would store the report along the task.

More over the deferred processing module + Aeroo Reports would work transparently, you can set a threshold for each report, to initiate deferred task, if not exceeded it would run Aeroo report as usual - without creating deferred task.

You can integrate other long running processes to be used as deferred tasks, like mass recalculations etc.

Ok there is one "problem" - you need to redevelop "original" reports into Aeroo.

BR Kaspar

0
Imagine profil
Abandonează
Akhmad Daniel Sembiring
Autor

hi Kaspar, currently i used webkit report, do you think it's the same as RML report in performance?

Imagine profil
Rohit Thakral
Cel mai bun răspuns

Hi Akhmad,

We upgraded our server and created a swap space of 8GB which allowed us to run a 700+ page long General Ledger Report.

The suggestion of Aeroo reports is good and we were thinking of converting the GL report to HTML (and not PDF). It seems it is convert to PDF which was causing problems and not fetching the data.

HTH Rohit

0
Imagine profil
Abandonează
Akhmad Daniel Sembiring
Autor

Hi Rohit did you mean creating swap space of 8GB on the OS/Linux? what is the size of PDF generated in your case?

Thanks

Imagine profil
Akhmad Daniel Sembiring
Autor Cel mai bun răspuns

Hi Rohit did you mean creating swap space of 8GB on the OS/Linux? what is the size of PDF generated in your case?

Thanks

0
Imagine profil
Abandonează
Enjoying the discussion? Don't just read, join in!

Create an account today to enjoy exclusive features and engage with our awesome community!

Înscrie-te
Related Posts Răspunsuri Vizualizări Activitate
high volume of data failed to generate report
postgres volume high tuning
Imagine profil
Imagine profil
1
feb. 16
7271
Problems with Docker volumes Rezolvat
postgres volume Docker
Imagine profil
Imagine profil
1
dec. 21
9329
In debian package v8, can't set database name
postgres
Imagine profil
Imagine profil
Imagine profil
3
feb. 24
6684
Killing idle postgres processes Rezolvat
postgres
Imagine profil
Imagine profil
8
feb. 21
16457
Odoo 11 is slow to backup because of multiple postgres processes
postgres
Imagine profil
0
feb. 21
2691
Comunitate
  • Tutorials
  • Documentație
  • Forum
Open Source
  • Descărcare
  • Github
  • Runbot
  • Translations
Servicii
  • Hosting Odoo.sh
  • Suport
  • Actualizare
  • Custom Developments
  • Educație
  • Găsiți un contabil
  • Găsește un Partener
  • Devino Partener
Despre Noi
  • Compania noastră
  • Active de marcă
  • Contactați-ne
  • Locuri de muncă
  • Evenimente
  • Podcast
  • Blog
  • Clienți
  • Aspecte juridice • Confidențialitate
  • Securitate
الْعَرَبيّة Català 简体中文 繁體中文 (台灣) Čeština Dansk Nederlands English Suomi Français Deutsch हिंदी Bahasa Indonesia Italiano 日本語 한국어 (KR) Lietuvių kalba Język polski Português (BR) română русский язык Slovenský jazyk slovenščina Español (América Latina) Español ภาษาไทย Türkçe українська Tiếng Việt

Odoo este o suită de aplicații de afaceri open source care acoperă toate nevoile companiei dvs.: CRM, comerț electronic, contabilitate, inventar, punct de vânzare, management de proiect etc.

Propunerea de valoare unică a Odoo este să fie în același timp foarte ușor de utilizat și complet integrat.

Website made with

Odoo Experience on YouTube

1. Use the live chat to ask your questions.
2. The operator answers within a few minutes.

Live support on Youtube
Watch now