[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: feature request: gzip/bzip support for sort
From: |
Jim Meyering |
Subject: |
Re: feature request: gzip/bzip support for sort |
Date: |
Thu, 18 Jan 2007 22:06:45 +0100 |
Dan Hipschman <address@hidden> wrote:
> On Sat, Jan 13, 2007 at 10:07:59PM -0800, Paul Eggert wrote:
>> 3. I can see where the user might be able to specify a better
>> algorithm, for a particular data set. For that, how about if we have
>> a --compress-program=PROGRAM option, which lets the user plug in any
>> program that works as a pipeline? E.g., --compress-program=gzip would
>> use gzip. The default would be to use "PROGRAM -d" to decompress; we
>> could have another option if that doesn't suffice.
>
> This is pretty close. There is just a few more problems that I see:
One more thing to consider:
In your proposed patch, a failed fork evokes an immediate exit.
In that case, it may be worthwhile to retry, or even to revert
to using gzip directly.
Consider sort's merge phase, and imagine having 40 compressed files,
each hooked to a process running gzip -d. It's not hard to imagine
an environment in which some of those fork calls would fail.
- Re: feature request: gzip/bzip support for sort, (continued)
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Paul Eggert, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Bauke Jan Douma, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Philip Rowlands, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Philip Rowlands, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/16
- Re: feature request: gzip/bzip support for sort, James Youngman, 2007/01/16
- Re: feature request: gzip/bzip support for sort,
Jim Meyering <=
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/18