Re: [Duplicity-talk] duplicity very slow

[covici]

OK, running with debug, so far the log is about a gig, but I found
already a few suspicious things:
u'duplicity-new-signatures.20160516T200242Z.to.20160518T050950Z.sigtar.gpg',
u'duplicity-new-signatures.20160518T050950Z.to.20160519T223603Z.sigtar.gpg']
File duplicity-full-signatures.20160506T202416Z.sigtar.gpg is not part
of a known set; creating new set
Ignoring file (rejected by backup set)
'duplicity-full-signatures.20160506T202416Z.sigtar.gpg'
File duplicity-full.20160506T202416Z.manifest.gpg is not part of a known
set; creating new set
File duplicity-full.20160506T202416Z.vol1.difftar.gpg is part of known
set
and so on for thousands of lines.  Now it is doing the backup and
comparing each file with the exclude list like this:
Selection: examining path /audio
Selection:     result: None from function: Command-line exclude glob:
/proc/*
Selection:     result: None from function: Command-line exclude glob:
/sys/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/sda12/var/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/rdiff_backup/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/ccs2c/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/ccs2d/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/ccs2e/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/ccs2f/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/misc/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/misc2/*
Selection:     result: None from function: Command-line exclude glob:
/var/lib/php5/*
Selection:     result: None from function: Command-line exclude glob:
/usr/tmp/*
Selection:     result: None from function: Command-line exclude glob:
/tmp/*
Selection:     result: None from function: Command-line exclude glob:
/audio/tmp/*
Selection:     result: None from function: Command-line exclude glob:
/audio/001*.wav
Selection:     result: None from function: Command-line exclude glob:
/var/spool/mail/spam
Selection:     result: None from function: Command-line exclude glob:
**caughtspam
Selection:     result: None from function: Command-line exclude glob:
/var/account/pacct
Selection:     result: None from function: Command-line exclude glob:
/mnt/scratch/*.mig
Selection:     result: None from function: Command-line exclude glob:
/mnt/oldgentoo/proc/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/oldgentoo/sys/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/oldgentoo/usr/src/*
Selection:     result: None from function: Command-line exclude glob:
/media/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/offsite/*
Selection:     result: None from function: Command-line exclude glob:
/var/tmp/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/sda12/proc/*
Selection:     result: None from function: Command-line exclude glob:
/usr/local/crashplan/cache/*
Selection:     result: None from function: Command-line exclude glob:
/var/spool/mqueue/*
Selection:     result: None from function: Command-line exclude glob:
/var/cache/samba/*
Selection:     result: None from function: Command-line exclude glob:
/mnt/cdrom/*
Selection:     result: None from function: Command-line exclude glob:
/run
Selection:     result: None from function: Command-line exclude glob:
/var/lib/fail2ban/*
Selection:     result: None from function: Command-line exclude glob:
/etc/runit/runsvdir/default/supervise
Selection:     result: None from function: Command-line exclude glob:
/dev/shm/*
Selection:     result: None from function: Command-line exclude glob:
/home/ext2_saved
Selection:     result: None from function: Command-line exclude glob:
/mnt/offsite/*
Selection:     result: None from function: Command-line exclude glob:
/root/.cache/*
Selection:     + including file
Selecting /audio
Comparing audio and audio
Selection: examining path /audio/.mp3crc
and so on.

Any way to fix the errors?

covici--- via Duplicity-talk <address@hidden> wrote:

> OK, next time I will do that.
> 
> address@hidden wrote:
> 
> > '-v9' debug, of course ;).. ede
> > 
> > On 20.05.2016 21:56, address@hidden wrote:
> > > What level of dump would you need for that, I normally set the verbosity
> > > at info.
> > > 
> > > edgar.soldin--- via Duplicity-talk <address@hidden> wrote:
> > > 
> > >> On 20.05.2016 21:50, covici--- via Duplicity-talk wrote:
> > >>> Hi.  I wonder what is taking so long for duplicity to work?  Yesterday I
> > >>> started one at 18:33, it said local and remote metadata was synced, no
> > >>> sync necessary, but the backup (incremental) did not start till 21:08.
> > >>> What is it doing for so long.  And to walk the tree looking for changes,
> > >>> it took another 3.5 hours.  Can anyone tell me what gives here, any way
> > >>> to speed things up?  I have about 1.3 terabytes of files, backing up to
> > >>> azure storage.
> > >>>
> > >>> Thanks in advance for any suggestions.
> > >>>
> > >>
> > >> you should really offer log dumps for questions like that. make sure to 
> > >> obfuscate strings you deem private in them beforehand.
> > >>
> > >> ..ede/duply.net
> > >>
> > >> _______________________________________________
> > >> Duplicity-talk mailing list
> > >> address@hidden
> > >> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> > >>
> > > 
> > 
> 
> -- 
> Your life is like a penny.  You're going to lose it.  The question is:
> How do
> you spend it?
> 
>          John Covici
>          address@hidden
> 
> _______________________________________________
> Duplicity-talk mailing list
> address@hidden
> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
> 

-- 
Your life is like a penny.  You're going to lose it.  The question is:
How do
you spend it?

         John Covici
         address@hidden