[Duplicity-tracker] [bug #24825] duplicity could nice to have: warn on insufficient TMPDIR space availability and low max open file limits pre-backup

[anonymous]

URL:
  <http://savannah.nongnu.org/bugs/?24825>

                 Summary: duplicity could nice to have: warn on insufficient
TMPDIR space availability and low max open file limits pre-backup
                 Project: duplicity
            Submitted by: None
            Submitted on: Thu 13 Nov 2008 05:00:50 AM UTC
                Category: None
                Severity: 3 - Normal
              Item Group: None
                  Status: None
                 Privacy: Public
             Assigned to: None
        Originator Email: 
             Open/Closed: Open
         Discussion Lock: Any

    _______________________________________________________

Details:

Hello.

Using duplicity 0.5.02 on Debian sid my backups were failing when backing up
~100k files with a total size of ~40GB.  I was getting pipe failures, temp dir
errors, etc.  The command used was simply:

  duplicity full /home/mydir file:///opt/dest/mydir

The problem was traced down to two things.  First was a tmpfs /tmp that was
100MB which was too small for this size of backup.  In testing I needed at
least 260MB of /tmp to complete a successful backup.  Alternatively I could
have just set --tempdir but IMO the default behaviour should at least error
out correctly when hitting this a temp dir limit.

The second culprit was a default max open files limit of 1024 which again was
too restrictive for this backup and was the cause of the pipe errors.  Bumping
it up to 4096 was required although more testing in this area should be done
as I'm still not convinced that this is the right solution.  It doesn't make
sense that duplicity would have so many files open but I have not had time to
test when is actually happening here.

Derrick





    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?24825>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/