Skip to Content
Odoo Menu
  • Sign in
  • Try it free
  • Apps
    Finance
    • Accounting
    • Invoicing
    • Expenses
    • Spreadsheet (BI)
    • Documents
    • Sign
    Sales
    • CRM
    • Sales
    • POS Shop
    • POS Restaurant
    • Subscriptions
    • Rental
    Websites
    • Website Builder
    • eCommerce
    • Blog
    • Forum
    • Live Chat
    • eLearning
    Supply Chain
    • Inventory
    • Manufacturing
    • PLM
    • Purchase
    • Maintenance
    • Quality
    Human Resources
    • Employees
    • Recruitment
    • Time Off
    • Appraisals
    • Referrals
    • Fleet
    Marketing
    • Social Marketing
    • Email Marketing
    • SMS Marketing
    • Events
    • Marketing Automation
    • Surveys
    Services
    • Project
    • Timesheets
    • Field Service
    • Helpdesk
    • Planning
    • Appointments
    Productivity
    • Discuss
    • Approvals
    • IoT
    • VoIP
    • Knowledge
    • WhatsApp
    Third party apps Odoo Studio Odoo Cloud Platform
  • Industries
    Retail
    • Book Store
    • Clothing Store
    • Furniture Store
    • Grocery Store
    • Hardware Store
    • Toy Store
    Food & Hospitality
    • Bar and Pub
    • Restaurant
    • Fast Food
    • Guest House
    • Beverage Distributor
    • Hotel
    Real Estate
    • Real Estate Agency
    • Architecture Firm
    • Construction
    • Estate Management
    • Gardening
    • Property Owner Association
    Consulting
    • Accounting Firm
    • Odoo Partner
    • Marketing Agency
    • Law firm
    • Talent Acquisition
    • Audit & Certification
    Manufacturing
    • Textile
    • Metal
    • Furnitures
    • Food
    • Brewery
    • Corporate Gifts
    Health & Fitness
    • Sports Club
    • Eyewear Store
    • Fitness Center
    • Wellness Practitioners
    • Pharmacy
    • Hair Salon
    Trades
    • Handyman
    • IT Hardware & Support
    • Solar Energy Systems
    • Shoe Maker
    • Cleaning Services
    • HVAC Services
    Others
    • Nonprofit Organization
    • Environmental Agency
    • Billboard Rental
    • Photography
    • Bike Leasing
    • Software Reseller
    Browse all Industries
  • Community
    Learn
    • Tutorials
    • Documentation
    • Certifications
    • Training
    • Blog
    • Podcast
    Empower Education
    • Education Program
    • Scale Up! Business Game
    • Visit Odoo
    Get the Software
    • Download
    • Compare Editions
    • Releases
    Collaborate
    • Github
    • Forum
    • Events
    • Translations
    • Become a Partner
    • Services for Partners
    • Register your Accounting Firm
    Get Services
    • Find a Partner
    • Find an Accountant
    • Meet an advisor
    • Implementation Services
    • Customer References
    • Support
    • Upgrades
    Github Youtube Twitter Linkedin Instagram Facebook Spotify
    +1 (650) 691-3277
    Get a demo
  • Pricing
  • Help

Odoo is the world's easiest all-in-one management software.
It includes hundreds of business apps:

  • CRM
  • e-Commerce
  • Accounting
  • Inventory
  • PoS
  • Project
  • MRP
All apps
You need to be registered to interact with the community.
All Posts People Badges
Tags (View all)
odoo accounting v14 pos v15
About this forum
You need to be registered to interact with the community.
All Posts People Badges
Tags (View all)
odoo accounting v14 pos v15
About this forum
Help

[FIXED] CSV Product Import Issues. Import preview failed due to: field larger than field limit (131072).

Subscribe

Get notified when there's activity on this post

This question has been flagged
2 Replies
16320 Views
Avatar
Luke Branch

[UPDATE 2015-03-01]

This issue has been fixed in the following PR:

https://github.com/odoo/odoo/commit/68f14c68709bbb50cb7fb66d288955e1d769c5ff


I've been trying to figure out a way to import product images effectively into our database and have been running into the same issues as most in this forum (ie. red status notification with no text inside). I therefore slowly started trying to validate imports using larger product field sets and pictures every time (started with 5 and moved on to 20 at a time with larger images).

I then came across this error:

Import preview failed due to: field larger than field limit (131072). The issue is usually an incorrect file encoding.

I have googled the error and come across this article regarding the error in python:

http://lethain.com/handling-very-large-csv-and-xml-files-in-python/

and a possible solution in this stackoverflow post:

http://stackoverflow.com/questions/15063936/csv-error-field-larger-than-field-limit-131072

I've then backed up the following file:

/opt/odoo/odoo-server/addons/base_import/models.py

and added the following to the top of the file:

import sys
import csv
maxInt = sys.maxsize
decrement = True

while decrement:
    # decrease the maxInt value by factor 10 
    # as long as the OverflowError occurs.

    decrement = False
    try:
        csv.field_size_limit(maxInt)
    except OverflowError:
        maxInt = int(maxInt/10)
        decrement = True

and then I have restarted the server. I understand that modifiying core code is not a smart idea, so if it works I will post back here as an answer to confirm, however does anyone know how this might be implemented as a module to override the default setting rather than modifying the core files?

2
Avatar
Discard
Luke Branch
Author

Resolved here:

https://github.com/odoo/odoo/commit/68f14c68709bbb50cb7fb66d288955e1d769c5ff

Avatar
Luke Branch
Author Best Answer

The fix above definitely works. I have just finished an import with thousands of large images inside a CSV.

  1. make a backup of /opt/odoo/odoo-server/addons/base_import/models.py (or whereever /addons/base_import/ is located in your instance).
  2. add the following lines at the very top of the file:
    1. import sys
      import csv
      maxInt = sys.maxsize
      decrement = True

      while decrement:
          # decrease the maxInt value by factor 10 
          # as long as the OverflowError occurs.

          decrement = False
          try:
              csv.field_size_limit(maxInt)
          except OverflowError:
              maxInt = int(maxInt/10)
              decrement = True

  3. Restart the odoo server.

The issue was resolved due to this stackoverflow post:

http://stackoverflow.com/questions/15063936/csv-error-field-larger-than-field-limit-131072

This needs to be packaged into a module though as this method relies on editing core files to achieve a solution.

0
Avatar
Discard
Avatar
Snehal Chauhan
Best Answer

above solution does not work on windows server, any suggestion

0
Avatar
Discard
Luke Branch
Author

@Snehal, I think this solution should be platform independent. Have you tried restarting your odoo-server, or running an odoo-server --update=all when starting (make sure you're fully backed up first)?

Enjoying the discussion? Don't just read, join in!

Create an account today to enjoy exclusive features and engage with our awesome community!

Sign up
Community
  • Tutorials
  • Documentation
  • Forum
Open Source
  • Download
  • Github
  • Runbot
  • Translations
Services
  • Odoo.sh Hosting
  • Support
  • Upgrade
  • Custom Developments
  • Education
  • Find an Accountant
  • Find a Partner
  • Become a Partner
About us
  • Our company
  • Brand Assets
  • Contact us
  • Jobs
  • Events
  • Podcast
  • Blog
  • Customers
  • Legal • Privacy
  • Security
الْعَرَبيّة Català 简体中文 繁體中文 (台灣) Čeština Dansk Nederlands English Suomi Français Deutsch हिंदी Bahasa Indonesia Italiano 日本語 한국어 (KR) Lietuvių kalba Język polski Português (BR) română русский язык Slovenský jazyk slovenščina Español (América Latina) Español ภาษาไทย Türkçe українська Tiếng Việt

Odoo is a suite of open source business apps that cover all your company needs: CRM, eCommerce, accounting, inventory, point of sale, project management, etc.

Odoo's unique value proposition is to be at the same time very easy to use and fully integrated.

Website made with

Odoo Experience on YouTube

1. Use the live chat to ask your questions.
2. The operator answers within a few minutes.

Live support on Youtube
Watch now