[Octave-bug-tracker] [bug #53456] output_precision: Cannot set precision higher than 16

[Oliver Heimlich]

URL:
  <http://savannah.gnu.org/bugs/?53456>

                 Summary: output_precision: Cannot set precision higher than
16
                 Project: GNU Octave
            Submitted by: oheim
            Submitted on: Sun 25 Mar 2018 12:24:22 AM CET
                Category: Octave Function
                Severity: 3 - Normal
                Priority: 5 - Normal
              Item Group: Regression
                  Status: None
             Assigned to: None
         Originator Name: Oliver Heimlich
        Originator Email: 
             Open/Closed: Open
         Discussion Lock: Any
                 Release: dev
        Operating System: Any

    _______________________________________________________

Details:

This is probably related to bug #53167.


>> output_precision (17)
error: output_precision: arg must be less than or equal to 16


The current documentation for this function suggests that you can set a higher
value, but that is not possible anymore.

Also, I don't understand why the limit has been introduced. Double precision
numbers can have up to 751 significant digits, see pow2 (-1074).




    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?53456>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/