[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Bug-tar] Multi-threaded tar
From: |
Joerg Schilling |
Subject: |
Re: [Bug-tar] Multi-threaded tar |
Date: |
Tue, 31 Jul 2018 12:23:12 +0200 |
User-agent: |
Heirloom mailx 12.5 7/5/10 |
"J.R. Heisey" <address@hidden> wrote:
> Greetings,
>
> I was trying to make some processes faster which use tar a bit on large
> archives.
>
> I was able to use the command line options --use-compress-program pbzip2 and
> that helped a lot.
>
> I was wondering if anyone has experimented using pthreads in the tar
> implementation. I don't see any references in version 1.30 of the source or
> readme I downloaded. Anyone discussed a strategy for using pthreads in
> previous postings?
Star forks and runs two processes since approx. 30 years.
The first process is for the filesystem I/O and the second process is for the
archive I/O. between both, there is a ring buffer with configurable size that
decouples both tasks. This helps to make star very fast.
Implementing something like this in a TAR implementation that does not yet have
support for it is highly complex.
Jörg
--
EMail:address@hidden (home) Jörg Schilling D-13353 Berlin
address@hidden (work) Blog: http://schily.blogspot.com/
URL: http://cdrecord.org/private/ http://sf.net/projects/schilytools/files/'