2016-05-06 10:27 AM - last edited on 2023-05-24 08:40 AM by Rubia Torres
2016-05-06 12:08 PM
2016-05-06 01:53 PM
Macbook Pro M1 Max 64GB ram, OS X 10.XX latest
another Moderator
2016-05-06 03:44 PM
2016-05-06 04:53 PM
2016-05-07 12:43 PM
laszlonagy wrote:I'm familiar with PostgreSQL datatypes, not C++. In PostgreSQL "double precision" is inexact floating number.
double type C++ variables
PostgreSQL wrote:With a float number the digits there is no reservation for the integer and fractional part of the number. The double precision type typically has a range of around 1E-307 to 1E+308 with a precision of at least 15 digits.
Inexact means that some values cannot be converted exactly to the internal format and are stored as approximations, so that storing and retrieving a value might show slight discrepancies.
laszlonagy wrote:In my preferences the max number of digits is 4 this means: 0,0001m. And if I switch to mm it is 1 digit.
Also, what is a fact is that Dimensions can show measurements up to 0.000001 meter accuracy (if you turn on those 2 digits of extra accuracy in Project Preferences), so I guess data is stored at least to that accuracy.
2016-05-08 05:04 AM