[Octave-bug-tracker] [bug #53167] format long doesn't adjust precision to 7 digits when displaying single() values

[John W. Eaton]

Follow-up Comment #7, bug #53167 (project octave):

Another reason for the output_precision variable was to allow more
fine-grained control than just format long or short.  Is it acceptable to drop
that feature?  I'm OK with limiting output to no more than the number of
digits that are meaningful, but it would be nice to maintain the ability to
get, say 10 digits for doubles, not just 8 or 16.

That's why I asked whether there should be just one value of output_precision,
and then limit the actual output to the max number of meaningful digits for
the type.  If we do that and have only one output_precision value, then users
could set output_precision to whatever value and we would impose a limit when
printing.  But if we have separate output_precision values for single and
double, we can limit their ranges at the time they are set from a
user-provided value.


    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?53167>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/