[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
floating point print out
From: |
David Grohmann |
Subject: |
floating point print out |
Date: |
Fri, 08 Jun 2007 16:29:45 -0500 |
User-agent: |
Thunderbird 1.5.0.12 (Windows/20070509) |
I have printed out a floating point number in format long e
1.00000000000000e-00 which is apparently slightly less than
1.00000000000000e00
debug> x
ans = 1.00000000000000e-00
debug> x < 1
ans = 1.00000000000000e+00
debug> 1 - x
ans = 1.11022302462516e-16
What is the decimal value for 1.00000000000000e-00 , is it not possible
to show? entering in the text "1.00000000000000e-00" to an octave prompt
produces:
debug> 1.00000000000000e-00
ans = 1.00000000000000e+00
I ran the same code on matlab that produced this number and instead got
9.897959183673469e-001
I know I will need to post the code and I will if I am allowed (and find
a way to boil the problem down to a small test case). But I'm still
wondering what 1.00000000000000e-00 means negative zero exponent. And
do you believe this is a bug that could be important?
debug> version
ans = 2.9.10
--
David Grohmann
Senior Student Associate
Applied Research Lab : UT Austin : ESL - S206
Office: 512-835-3237
[Prev in Thread] |
Current Thread |
[Next in Thread] |
- floating point print out,
David Grohmann <=