[Octave-bug-tracker] [bug #65712] sort over InF dimension coredumps

[Arun Giridhar]

Follow-up Comment #17, bug #65712 (group octave):

I think the previous line "dv.resize (dim+1, 1);" in Array-base.cc was the
code leading to memory usage. In my patch, I'm returning early now instead.

I'll have to revisit the strict_int_value topic tomorrow. I would certainly
prefer sort() to give an error for fractional dimensions, which is what I did
except for an extra BIST with inf that started this crash. I think that
strict_int check would also solve your comment #13 and comment #14. I do not
know what Matlab behavior is -- do they silently convert fractional inputs to
the floor?


    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?65712>

_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/