parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

My record with GNU Parallel


From: Ole Tange
Subject: My record with GNU Parallel
Date: Tue, 18 Apr 2017 01:06:43 +0200

Today I ran:

  seq 1000000 | parallel --pipe --tee wc ::: {1..13000}

This feeds 6.8 MB to 13000 wc's running in parallel (+ 26000 helper
processes) giving a total of 39000 parallel processes. It took 15 GB
RAM and did not feel very fast. But it worked correctly.

It also required 'ulimit -u 40000; ulimit -n 100000'.

Have you used GNU Parallel to push your system to the limit?
What is your record?

/Ole



reply via email to

[Prev in Thread] Current Thread [Next in Thread]