Community mailing list archives

community@mail.odoo.com

Re: Odoo - BigData!

by
Cristian Salamea
- 10/26/2015 10:07:10


On Sun, Oct 25, 2015 at 7:34 PM, Nhomar Hernández <nhomar@gmail.com> wrote:

2015-10-25 14:07 GMT-05:00 Jay Vora <vora.jay@serpentcs.com>:
So, we at SerpentCS thought of something to start, atleast a study and if someone is working on that, can join hands!

The github repo has born! 

Suggestions, feedback and guidance invited!

Happy ODOOing!

Good initiative.

But just FYI.

Mostly datamining tools are already in Python itself and every implementation is a very especific case.

It should be cool if you share your vision to understand the objective better.

For example:

To data mining we use "pandas" if things become more complicated we mix that with huge SQL + Pandas.

You have a very complete set of libraries here.

Then, if such libraries has the "generic" implementation for data mining concepts, "Which is especifically the objective of this project?"

Reports?, Use cases?, Documentation? all of them?

The first step in this world is understand what means "big data" and is more related about how to storage data, as you read in next post people is working with others DB systems, IMO the first step here is check in odoo how manage this.

The output of this work could be some new fields type like JSON, JSONB, HSTORE, ARRAYS ( PG types and all of us, love postgres).

For example if we get JSON field, all contacts from partner could be stored in one column or manage product attributes in the same way.

This could be the first step to get big amounts of data in new type of storage to be managed fast, some challenges [1] are highly recommended.

Obviosly is not just about data in PG, there is other data like logs from odoo could be analyzed, like errors and learn from this data using tools like elastic products: logstash[2], search and kibana[3]

This last tools can used like mining too, and many others too but all of this will looking for data and how is stored.

This topic is really beautiful and of course how we can get new types from our postgres.

Regards !


Regards and thanks for share.

--
--------------------
Saludos Cordiales

CEO at Vauxoo Odoo's Gold Partner.
 
--
Nhomar Hernandez
 

_______________________________________________
Mailing-List: https://www.odoo.com/groups/community-59
Post to: mailto:community@mail.odoo.com
Unsubscribe: https://www.odoo.com/groups?unsubscribe




--
 
Cristian Salamea on about.me
 
Cristian Salamea
about.me/ovnicraft