parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

feature suggestion: --preserve-blocking-factor


From: Cook, Malcolm
Subject: feature suggestion: --preserve-blocking-factor
Date: Thu, 16 Feb 2017 18:16:08 +0000

When using the --spreadstdin option, it may be desirable to ensure that the 
blocks "keep together" certain blocks of data.

For example the input may be sorted on column 3, and it may be the case that 
all lines having the same value for column 3 must be processed together.

Providing an option that allows for block breaks to be respect grouped records 
such as this would 

Perhaps a --preserve-blocking-factor option, which would be another stream/file 
that defined the blocking factor.

Allowing something like:

        cat someHugeTabFile parallel  --preserve-blocking-factor <(cut -f 3 
someHugeTabFile) someProg

or perhaps

        cat someHugeTabFile parallel  --preserve-blocking-factor '| cut -f 3' 
someProg



Malcolm Cook




reply via email to

[Prev in Thread] Current Thread [Next in Thread]