[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Octave-bug-tracker] [bug #37880] Make factor to not show wrong answers
|
From: |
Rik |
|
Subject: |
[Octave-bug-tracker] [bug #37880] Make factor to not show wrong answers for large numbers |
|
Date: |
Mon, 21 Oct 2013 22:19:12 +0000 |
|
User-agent: |
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:24.0) Gecko/20100101 Firefox/24.0 |
Update of bug #37880 (project octave):
Status: Patch Submitted => Fixed
Open/Closed: Open => Closed
_______________________________________________________
Follow-up Comment #3:
I modified and applied your patch here
(http://hg.savannah.gnu.org/hgweb/octave/rev/e48f5a52e838). This will be a
part of the 3.8 release due out in a few weeks.
It seems like we could actually do better if we switched to calculating with
int64, instead of double. I tested this idea and it works for numbers above
bitmax(), but there is a problem with the prod() function in that it only
works in double precision. If we fix that to be able to use the class of the
inputs to prod() then this restriction can be lifted.
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?37880>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/