|
From: | Mike Miller |
Subject: | [Octave-bug-tracker] [bug #53683] numerical output format for float values with magnitude greater than precision is wrong |
Date: | Tue, 17 Apr 2018 21:21:06 -0400 (EDT) |
User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0 |
Update of bug #53683 (project octave): Item Group: Incorrect Result => Regression _______________________________________________________ Follow-up Comment #2: In previous versions of Octave: for i = -2:8; 10^i/3, endfor ans = 0.0033333 ans = 0.033333 ans = 0.33333 ans = 3.3333 ans = 33.333 ans = 333.33 ans = 3333.3 ans = 3.3333e+04 ans = 3.3333e+05 ans = 3.3333e+06 ans = 3.3333e+07 I believe Matlab also switches to scientific notation when the range of the value exceeds the output precision setting. _______________________________________________________ Reply to this item at: <http://savannah.gnu.org/bugs/?53683> _______________________________________________ Message sent via/by Savannah http://savannah.gnu.org/
[Prev in Thread] | Current Thread | [Next in Thread] |