[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: feature request: gzip/bzip support for sort
From: |
Dan Hipschman |
Subject: |
Re: feature request: gzip/bzip support for sort |
Date: |
Thu, 18 Jan 2007 17:47:53 -0800 |
User-agent: |
Mutt/1.5.9i |
On Thu, Jan 18, 2007 at 10:06:45PM +0100, Jim Meyering wrote:
> One more thing to consider:
>
> In your proposed patch, a failed fork evokes an immediate exit.
> In that case, it may be worthwhile to retry, or even to revert
> to using gzip directly.
>
> Consider sort's merge phase, and imagine having 40 compressed files,
> each hooked to a process running gzip -d. It's not hard to imagine
> an environment in which some of those fork calls would fail.
That's a thought, although libz only works with gzip (as you said), and
it will add more complexity (like my original patch using LZO and this
new one combined). I don't think we'll have 40 instances of gzip -d
running. We should only need at most one compression process, and
NMERGE (16) decompression processes running at one time. I think
retrying fork if it fails is a good idea, and I've already added that
since I read your mail.
- Re: feature request: gzip/bzip support for sort, (continued)
- Re: feature request: gzip/bzip support for sort, Bauke Jan Douma, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Philip Rowlands, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Philip Rowlands, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/16
- Re: feature request: gzip/bzip support for sort, James Youngman, 2007/01/16
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort, Jim Meyering, 2007/01/18
- Re: feature request: gzip/bzip support for sort,
Dan Hipschman <=
- Re: feature request: gzip/bzip support for sort, Dan Hipschman, 2007/01/18