This question has been flagged

I am new here. I am working on Purchase Management where i ve a csv files and want to produce a code that imports all data from file and place in database just on clicking button. For a moment i ve added import button xml bt i need help how shd i proceed in order to do so.

http://imgur.com/a/dcSnX

Avatar
Discard

On Sat, Aug 26, 2017 at 1:21 PM, Yenthe <yenthespam@gmail.com> wrote:

A new question How to use import button for custom development? on Help has been posted. Click here to access the question :

See question

--
Yenthe


Sent by Odoo S.A. using Odoo.



On Sun, Oct 22, 2017 at 1:32 PM, Zohaib Rehman <zohaibrehman1991@gmail.com> wrote:

On Sat, Aug 26, 2017 at 1:21 PM, Yenthe <yenthespam@gmail.com> wrote:

A new question How to use import button for custom development? on Help has been posted. Click here to access the question :

See question

--
Yenthe


Sent by Odoo S.A. using Odoo.



Best Answer

I think the best approach would be to create a wizard for this. You generate a wizard by creating a class that inherits from TransientModel. An instance of it will not stay in the database forever, as it is intended for processes (for example your import).

I would suggest, that you create a completely new view with a file upload dialog and an import button. The xml for that looks something like this (you'll have to adapt the names):

<odoo>
<data>
<record id="your_wizard_form" model="ir.ui.view">
<field name="name">your.wizard.form</field>
<field name="model">your_wizard</field>
<field name="arch" type="xml">
<form string="Import a csv file">
<group name="main">
<field name="csv_file" />
</group>

<footer>
<button name="import_csv" type="object"
string="Import" class="oe_highlight"/>
<button special="cancel" string="Cancel"/>
</footer>

</form>
</field>
</record>

<record id="your_wizard_action" model="ir.actions.act_window">
<field name="name">Import a csv file</field>
<field name="res_model"your_wizard</field>
<field name="view_mode">form</field>
<field name="target">new</field>
</record>

<menuitem id="your_wizard_menu"
parent="SOME_MENU_IN_PURCHASE"
action="your_wizard_action"
sequence="15" />
</data>
</odoo>

What this does is the following:

- You create a new view your_wizard_form with a field csv_file (your file upload), and two buttons: Import and Cancel. Cancel is handled by Odoo by default, if you define it as special="cancel". The import button will execute the python function import_csv of the model your_wizard.

- The remaining stuff is basically additional code, to add your import dialog as a menu item. You don't have to do it like this, there are other ways too.

Now to the python code. Your wizard class should look like this:

class YourWizard(models.TransientModel):
_name = 'your_wizard'
    # your file will be stored here:
csv_file = fields.Binary(string='CSV File', required=True)
     
    @api.multi
    def import_csv(self):
        # this will get executed when you click the import button in your form
        return {}

Here fields.Binary tells Odoo, that this is a file upload. Your file will get stored in base64 encoded form, so to use the csv reader, you'll have to at first decode it from base64 and split it into lines for the csv python module:

reader = csv.DictReader(base64.b64decode(self.csv_file).split('\n'))

Then you'll have a DictReader that you can use to read the data from your csv file and create new records directly in the database.

Note that this will only work for csv files encoded with UTF-8. For files with different encodings, you have to insert another step:

reader = csv.DictReader(base64.b64decode(self.csv_file).decode('file_encoding').encode('utf-8').split('\n'))

where you replace file_encoding with the correct encoding (I have seen you are using Linux, you can get the file encoding using the 'file' command).

This is probably a lot to digest and it does not even tell you how to write the data to the database. If you could specify what you are trying to write, I might be able to help you further. Database writes are usually quite simple, once you know which fields of which models you want to write (that's the hard part).

EDIT: As noted in the comments, this code is copy-pasted from my own addon. I forgot to change some variable names (changed bom_file -> csv_file).

Avatar
Discard

What a well elaborated and presented answer! Thanks.

I have written an addon that does a very similar thing just last week, so I have mostly copy-pasted my code, hoping that OP does not have to go through all the headaches that I had with this.

Author

thanks for elaborating my question. whats bom_file?

Author

i am getting garbage value everytime

Author

here is my xml and python:

<record id="view_pack_operation_lot_form_custom" model="ir.ui.view">

<field name="name">stock.pack.operation.lots.form</field>

<field name="model">stock.pack.operation</field>

<field eval="20" name="priority"/>

<field name="inherit_id" ref="stock.view_pack_operation_lot_form" />

<field name="arch" type="xml">

<xpath expr="//button[@name='save']" position="after">

<form string="Import a csv file">

<!-- <group name="main"> -->

<field name="file" />

<!-- </group>

<footer> -->

<button name="import_csv" type="object"

string="Import" class="oe_highlight"/>

<button special="cancel" string="Cancel"/>

<!-- </footer> -->

</form>

</xpath>

</field>

</record>

python:

def import_csv(self, options):

csv_data = self.file

# TODO: guess encoding with chardet? Or https://github.com/aadsm/jschardet

encoding = options.get('encoding', 'utf-8')

if encoding != 'utf-8':

# csv module expect utf-8, see http://docs.python.org/2/library/csv.html

csv_data = csv_data.decode(encoding).encode('utf-8')

csv_iterator = csv.DictReader(base64.b64decode(self.file).split('\n'))

bom_file was an error, it should have been csv_file.

You have a small mistake in your decoding process: at first you have to decode self.file from base64 into plain text and then decode().encode(). I.e.:

csv_data = base64.b64decode(self.file).decode(encoding).encode('utf-8')

csv_iterator = csv.DictReader(csv_data.split('\n'))

That should hopefully work.

Author

thanks can u guide me how shd i place that value in existing database field model name : "stock.pack.operation.lot" and in addons its "stock_pack_operation".

i dnt know if m doing wrong? m trying to place value in database through file such that it shd display value like clicking on "add item"

example:

http://imgur.com/a/dcj2j

my code is nt placing value in "lot_name" any idea where am wrong?

class stockpackoperartionlot2(models.Model):

_inherit = 'stock.pack.operation.lot'

lot_name = fields.Char('Lot/Serial Number')

class Import2(models.Model):

_name = 'stock.pack.operation'

# _inherit = 'stock.pack.operation'

_inherit = ['stock.pack.operation.lot','stock.pack.operation']

# allow imports to survive for 12h in case user is slow

_transient_max_hours = 12.0

res_model = fields.Char('Model')

file = fields.Binary(string='BOM File', required=True)

file_name = fields.Char('File Name')

file_type = fields.Char('File Type')

@api.multi

def _addfromfile(self,val):

self.lot_name = val

@api.multi

def import_csv(self, options):

""" Returns a CSV-parsed iterator of all empty lines in the file

:throws csv.Error: if an error is detected during CSV parsing

:throws UnicodeDecodeError: if ``options.encoding`` is incorrect

"""

csv_data = self.file

# TODO: guess encoding with chardet? Or https://github.com/aadsm/jschardet

encoding = options.get('encoding', 'utf-8')

if encoding != 'utf-8':

# csv module expect utf-8, see http://docs.python.org/2/library/csv.html

csv_data = csv_data.decode(encoding).encode('utf-8')

# csv_iterator = csv.DictReader(base64.b64decode(self.file).split('\n')) #base64.b64decode(self.file)

csv_data = base64.b64decode(self.file).decode(encoding).encode('utf-8')

# csv_iterator = csv.DictReader(csv_data.split('\n'))

# return base64.b64decode(self.file)

self._addfromfile(csv_data.split('\n')[0])

The Import2 class should be a models.TransientModel and it should not inherit from anything.

What you essentially have to do in the function import_csv(self, options) is to extract the lot_name and either create a new record or modify an existing one.

If you want to create a new record, you can achieve this via:

self.env['stock.pack.operation.lot'].create({

'lot_name': lot_name,

# optionally other parameters, that you want to set if no defaults exist

}

If you want to modify an existing record, you have to somehow pass its id to the wizard, where you would do the following:

self.env['stock.pack.operation.lot'].browse(record_id_that_you_obtained).lot_name = lot_name

Which way do you want to do it?

Author

ok Done thank you very much for this epic help..... !!! plus voted as well


On Mon, Aug 28, 2017 at 4:30 AM, Dan Čermák <dan.cermak@cgc-instruments.com> wrote:

I have written an addon that does a very similar thing just last week, so I have mostly copy-pasted my code, hoping that OP does not have to go through all the headaches that I had with this.

--
Dan Čermák