Mathieu Bouchard wrote:
but what is highest positive integer number I can represent with the current pd float precision? 16bit? 32.767?
the highest positive integer is 340282346638528859811704183484516925440 but you really want to know which is the highest positive integer for which it is possible to subtract 1. It's 16777216 (I'm saying this number very often on pd-list).
that is true, maybe because this information is missing in the help patch. so, when I type this number into a number box, it says 1.67772e+07 but it still seems to work, because I can subtract 16777216 correctly.
for now, I am ok with a precision of 1cm.
You won't get it with just floats. You will have to use pairs of floats to get to this level.
I separate the longitude values at the comma, which means this number (16777216) has to represent a range of ~111 km which gives a precision of less than 0.7cm. marius.