Skip to Content
Menu
This question has been flagged
1 Reply
3799 Views

Hello, 


I must handle numbers with high decimal precision due to the type of data I am measuring.


When doing the exercise of saving the number 744123812.85936641353 it shows me 744,123,812.85936677456 and 744123812.85936653614 is stored in the data bd. I don't understand what I'm doing wrong.


Could you give me a hand?

num= fields.Float('Number', digits=(21,11))
Avatar
Discard
Best Answer

Hi Gustavo:

This is a standard issue with floating point arithmetic in python. Here's a link to a description of the issue and how to code to handle it.

https://docs.python.org/3/tutorial/floatingpoint.html?highlight=float precision

Avatar
Discard
Related Posts Replies Views Activity
0
Nov 23
953
0
Jun 23
2157
0
Oct 22
2024
0
Oct 22
2127
2
Oct 21
4447