help-octave
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Problem with precision


From: Fritz Fischer
Subject: Problem with precision
Date: Thu, 16 Jun 2011 16:34:50 +0200

Hello!

I have a problem with Octave's precision and hope that you can help me.

My function writes data to a file, usually using a normal precision. But some
values are written with a very high precision and in the exponential format:

44.875
40.262
35.327
30.005
20.981
6.9638e-28
0
0

Can someone tell me how to fix this? I tried format short and format long
but the output is the same at both settings.

Since the files are used as input for another program that does not
understand the exponential format I need to change this.

Kind regards,
Walter






reply via email to

[Prev in Thread] Current Thread [Next in Thread]