parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Multiple lines?


From: Matthew Lai
Subject: Re: Multiple lines?
Date: Fri, 10 Apr 2015 04:01:20 +0100
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.6.0

I had only skimmed through the tutorial and couldn't find it.

I took your reply to mean it is possible and I should therefore invest more time into it.

I did find what I was looking for after a more detailed pass.

Thanks
Matthew

On 2015-04-09 1:52 AM, Ole Tange wrote:
On Sat, Mar 28, 2015 at 3:56 PM, Matthew Lai <m@matthewlai.ca> wrote:

Just wondering if there is an option to divide things up in blocks of lines?

For example, if there is a file with a million lines, is there a way to run
4 processes, with 250k lines input each?

I have a large file I want to process in parallel, but the command has high
startup overhead.
Before I answer that, please tell me whether you have:

* watched the intro videos (http://pi.dk/1)
* walked through the tutorial (man parallel_tutorial)
* read the examples in the man page (LESS=+/EXAMPLE: man parallel)


/Ole




reply via email to

[Prev in Thread] Current Thread [Next in Thread]