[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Lzip-bug] lzip and pipes
From: |
Daniel Klein |
Subject: |
Re: [Lzip-bug] lzip and pipes |
Date: |
Sun, 29 Sep 2019 14:18:47 +0000 |
Hi Antonio,
On 9/29/19 2:03 PM, Antonio Diaz Diaz wrote:
> All processes block I/O feed to them via pipe if the producer is faster than
> the consumer. It is usually not noticed because most programs read data in
> small blocks. When compressing, lzip reads data in large blocks (one
> dictionary size at a time). It does this for efficiency reasons; each time
> it reads a block, it needs to make room for it with memmove. Reading the
> data in smaller blocks would probably make it slower, not faster.
I figured something like that, i just wondered how other compressors handle
that, as they seem not to block that "heavy".
However, thank you, on to non blocking stuff ;-)
Daniel