[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Octave-bug-tracker] [bug #53456] output_precision: Cannot set precision
|
From: |
Mike Miller |
|
Subject: |
[Octave-bug-tracker] [bug #53456] output_precision: Cannot set precision higher than 16 |
|
Date: |
Mon, 26 Mar 2018 15:15:14 -0400 (EDT) |
|
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0 |
Follow-up Comment #1, bug #53456 (project octave):
If the limit were removed, you would still only get 16 digits for
double-precision values and 8 digits for single-precision values.
The new behavior is that output_precision() is a cap on the default output
width. But it will never increase the default output width from 8 or 16 for
single and double values respectively. If you set output_precision to 50, you
would still only get 16 digits. So that's the meaning of the new error
message.
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?53456>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/