[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Bug-tar] tar and load balancing
From: |
Jens Roder |
Subject: |
[Bug-tar] tar and load balancing |
Date: |
Sun, 17 Aug 2014 00:08:06 +0000 |
Hello,
currently, I am using tar to tar and bzip my scientific data into one data
packages. However, the data are on multiple NFS volumes. I realized, that tar
only reads from one volume, then goes to the next and so on. So first slave1 is
the limiting factor, then slave2 and so on, until all the data are taken. I
would like to ask, if it would be possible to put a load balancing option in
which tar would realize that the data are on different NFS volumes and then
starting to load balance the data streams of each device, so that all server
would provide equal data streams. It might be even another bonus to provide a
bandwithlimit option so that tar would process only a certain maximum data
stream per time unit. This would allow to run it in a mild mode without
affecting more important jobs.
Please let me know what you think.
with best wishes
Jens
[Prev in Thread] |
Current Thread |
[Next in Thread] |
- [Bug-tar] tar and load balancing,
Jens Roder <=