|
| From: | John Donoghue |
| Subject: | [Octave-bug-tracker] [bug #40607] mxe-octave: mixed uint64/double arithmetic incorrect (GUI-only) |
| Date: | Mon, 25 Nov 2013 19:55:57 +0000 |
| User-agent: | Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0) |
Follow-up Comment #42, bug #40607 (project octave):
Going back to the #define sub operation and then adding print direct to the
#define in /liboctave/util/oct-inttypes.cc
@@ -120,6 +120,7 @@
BEGIN_LONG_DOUBLE_ROUNDING (); \
\
long double retval = x OP y; \
+printf("a=%Lf\n", retval); \
\
END_LONG_DOUBLE_ROUNDING (); \
\
With the printf statement in there, I get the correct answer returned. Without
it I do not.
With the printf:
>> uint64(2)^63
ans = 9223372036854775808
>> uint64(2)^63-1
a=9223372036854775807.000000
ans = 9223372036854775807
>> uint64(2)^63-2
a=9223372036854775806.000000
ans = 9223372036854775806
>>
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?40607>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/
| [Prev in Thread] | Current Thread | [Next in Thread] |