[Octave-bug-tracker] [bug #60360] [octave forge] (package_name): fills up RAM, then crashes

[anonymous]

URL:
  <https://savannah.gnu.org/bugs/?60360>

                 Summary: [octave forge] (package_name): fills up RAM, then
crashes
                 Project: GNU Octave
            Submitted by: None
            Submitted on: Thu 08 Apr 2021 12:49:51 PM UTC
                Category: Octave Forge Package
                Severity: 3 - Normal
                Priority: 5 - Normal
              Item Group: None
                  Status: None
             Assigned to: None
         Originator Name: Matthias Brennwald
        Originator Email: mbrennwa@gmail.com
             Open/Closed: Open
                 Release: 6.2.0
         Discussion Lock: Any
        Operating System: GNU/Linux

    _______________________________________________________

Details:

The pararrayfun function seems to start too many parallel processes, such that
RAM fills up, and processes will fail.

Here's a simple example to illustrate the problem:


function y = paral_func(N,x);
        y = x + sum(sum(abs(fft(rand(N)))))/N^2;
endfunction

Nproc = nproc;
y = pararrayfun(Nproc, @(x) paral_func(10000,x), 1:100)


On my machine (ncore = 8 and 16 GB of RAM) I get this:

could not save variable.
could not save variable.
could not save variable.
could not save variable.
...
could not load variable
could not receive result
error: __parcellfun_get_next_result__: could not receive result
error: called from
    parcellfun at line 199 column 16
    pararrayfun at line 85 column 28
    paral0 at line 2 column 3


I guess parcellfun could just stop hammering out new processes once it runs
into this problem, and try again when one of the previously started processes
returns and has released its memory.

Or is it just me doing something wrong?




    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?60360>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/