[Octave-bug-tracker] [bug #42589] Inaccurate results with the colon operator

[Rik]

Follow-up Comment #20, bug #42589 (project octave):

Again, my point is that one shouldn't expect more than machine precision out
of numerical computing.  And the fact that people still do expect this is the
psychological problem.  The fraction of real numbers that can be represented
exactly by IEEE 64-bit floating point compared to the actual number of real
numbers in vanishingly small.  Statistically, most Octave calculations will
involve appproximations to true numbers and the final result will also be an
approximation in the range of eps away from the true answer.  In the
particular case of 0.1--and approximately 2^52 others--we can do better than
expected and jwe has already made that change.

The question still under discussion is whether to backport this to stable.  I
vote yes, but it is up jwe.

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?42589>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/