[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
My record with GNU Parallel
From: |
Ole Tange |
Subject: |
My record with GNU Parallel |
Date: |
Tue, 18 Apr 2017 01:06:43 +0200 |
Today I ran:
seq 1000000 | parallel --pipe --tee wc ::: {1..13000}
This feeds 6.8 MB to 13000 wc's running in parallel (+ 26000 helper
processes) giving a total of 39000 parallel processes. It took 15 GB
RAM and did not feel very fast. But it worked correctly.
It also required 'ulimit -u 40000; ulimit -n 100000'.
Have you used GNU Parallel to push your system to the limit?
What is your record?
/Ole
[Prev in Thread] |
Current Thread |
[Next in Thread] |
- My record with GNU Parallel,
Ole Tange <=