octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #53683] numerical output format for float valu


From: Mike Miller
Subject: [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong
Date: Tue, 17 Apr 2018 21:21:06 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0

Update of bug #53683 (project octave):

              Item Group:        Incorrect Result => Regression             

    _______________________________________________________

Follow-up Comment #2:

In previous versions of Octave:


for i = -2:8; 10^i/3, endfor
ans =  0.0033333
ans =  0.033333
ans =  0.33333
ans =  3.3333
ans =  33.333
ans =  333.33
ans =  3333.3
ans =    3.3333e+04
ans =    3.3333e+05
ans =    3.3333e+06
ans =    3.3333e+07


I believe Matlab also switches to scientific notation when the range of the
value exceeds the output precision setting.

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?53683>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]