[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Limiting memory used by parallel?
|
From: |
Joe Sapp |
|
Subject: |
Re: Limiting memory used by parallel? |
|
Date: |
Thu, 25 Jan 2018 11:26:24 -0500 |
Hi depesz,
On Thu, Jan 25, 2018 at 10:33 AM, hubert depesz lubaczewski
<depesz@depesz.com> wrote:
[snip]
> But it looks that parallel itself is consumming HUGE amount of memory
> - comparable with size of /some/directory itself.
>
> Server that I run it on has 64GB of ram, and the script gets killed
> after ~ 3 minutes with "Out of memory!" error.
Have you tried using --memfree? That will limit parallel from
spawning new processes
Joe