[Octave-bug-tracker] [bug #42742] polygcd fails valid test

[Rik]

Follow-up Comment #5, bug #42742 (project octave):

The following works for me in that it enlarges the tolerance based on the
input and all tests pass even when run repeatedly.


Change
tol = sqrt (eps);
to
tol = sqrt (eps (max (b)));


There is an intuitive logic to doing this, but I haven't been able to convince
myself rigorously why it should be so.



    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?42742>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/