[Octave-bug-tracker] [bug #37891] Segfault in __contourc__ when Java runtime is loaded

[Rik]

Follow-up Comment #4, bug #37891 (project octave):

Yes, the backtrace is around 2500 frames deep.  I tried increasing the
stacksize of the shell process running Octave but I still get segfaults.

The problem is in __contour__.cc.  I think the issue has been there all along,
but the Java interaction has exposed it.  I get the segfault in drawcn which,
if you look at the bottom of the function, will see is recursive and calls
itself.  This is how the frame stacks are building up.

The bottom of drawcn which stops the recursion is shown below, but it is still
something of a mystery.  If I put printf statements on some of the variables I
end up segfaulting in the printf routine.


if (next_r >= 0 && next_c >= 0 && next_r < mark.rows ()
    && next_c < mark.cols () && mark(next_r, next_c) > 0)
  {
    next_edge = (stop_edge + 2) % 4;
    drawcn (X, Y, Z, lvl, next_r, next_c, ct_x, ct_y, next_edge, false,
mark);
  }



    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?37891>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/