[Octave-bug-tracker] [bug #37830] Incorrect results from factor

[Doug Stewart]

Follow-up Comment #2, bug #37830 (project octave):

I think there is still a bug in factor.


octave:8> format long
octave:9>  qq=(100000000000000001)
qq =  100000000000000000

%  qq is a number that octave can store.

octave:11> factor(qq)
ans =

 Columns 1 through 6:

           2           3           5           7          13          17

 Columns 7 through 12:

          19          31          47          59          61          71

 Columns 13 through 18:

         103         179         251         661        1499        2297

 Columns 19 through 24:

        2309        4013       12713       20051       65701      252829

 Columns 25 through 30:

      281081      322249     2071723     3572939     3743297     9920467

 Columns 31 and 32:

    17985581   216273151

octave:12> prod(ans)
ans =  1.31390166944906e+109
octave:13> 

Octave returns an answer that is much much bigger than can be stored.

Doug Stewart

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?37830>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/