Re: [Duplicity-talk] AssertionError on Uppercase path name

[edgar . soldin]

On 26.12.2015 20:21, Bill Bixby wrote:
> A new user of Duplicity.
> Using Duply to drive it to backup a series of photo sub directories to Google 
> Drive.
> 
> The problem I've encountered is that if the directory name contains uppercase 
> I made a run with verbosity '-v9' but the logs didn't contain anything 
> additional than with v8.
> 
> The Duplicity command line Duply generated is:
> /usr/bin/duplicity --archive-dir /home/billsrv/duplicity --name duply_photost 
> --verbosity 9 --full-if-older-than 6M --volsize 128 --file-prefix 
> photost_Brook_Scan --name photost_Brook_Scan --exclude-filelist 
> /etc/duply/photost/exclude /photost/Brook_Scan 
> gdocs://address@hidden//photost/Brook_Scan
> 
> The photost directory with two subdirectories looks like:
> total 8
> drwxr-xr-x 2 root root 4096 Dec 26 13:25 Brook_Scan
> drwxr-xr-x 3 root root 4096 Dec 26 13:25 celtics_wallpaper
> 
> Full log of the failed Duply for Brook_Scan:
> Start duply v1.5.5.4, time is 2015-12-26 13:54:22.
> Using profile '/etc/duply/photost'.
> Using installed duplicity version 0.7.06, python 2.7.3, gpg 1.4.11 (Home: 
> ~/.gnupg), awk 'GNU Awk 3.1.8', bash '4.2.25(1)-release (x86_64-pc-linux-
> gnu)'.
> Signing disabled. Not GPG_KEY entries in config.
> Test - Encryption with passphrase (OK)
> Test - Decryption with passphrase (OK)
> Test - Compare (OK)
> Cleanup - Delete '/tmp/duply.14777.1451156062_*'(OK)
> 
> --- Start running command BKP at 13:54:23.069 ---
> Using archive dir: /home/billsrv/duplicity/photost_Brook_Scan
> Using backup name: photost_Brook_Scan
> Import of duplicity.backends.azurebackend Succeeded
> Import of duplicity.backends.b2backend Succeeded
> Import of duplicity.backends.botobackend Succeeded
> Import of duplicity.backends.cfbackend Succeeded
> Import of duplicity.backends.copycombackend Succeeded
> Import of duplicity.backends.dpbxbackend Succeeded
> Import of duplicity.backends.gdocsbackend Succeeded
> Import of duplicity.backends.giobackend Succeeded
> Import of duplicity.backends.hsibackend Succeeded
> Import of duplicity.backends.hubicbackend Succeeded
> Import of duplicity.backends.imapbackend Succeeded
> Import of duplicity.backends.lftpbackend Succeeded
> Import of duplicity.backends.localbackend Succeeded
> Import of duplicity.backends.megabackend Succeeded
> Import of duplicity.backends.multibackend Succeeded
> Import of duplicity.backends.ncftpbackend Succeeded
> Import of duplicity.backends.onedrivebackend Succeeded
> Import of duplicity.backends.par2backend Succeeded
> Import of duplicity.backends.pydrivebackend Succeeded
> Import of duplicity.backends.rsyncbackend Succeeded
> Import of duplicity.backends.ssh_paramiko_backend Succeeded
> Import of duplicity.backends.ssh_pexpect_backend Succeeded
> Import of duplicity.backends.swiftbackend Succeeded
> Import of duplicity.backends.sxbackend Succeeded
> Import of duplicity.backends.tahoebackend Succeeded
> Import of duplicity.backends.webdavbackend Succeeded
> Reading globbing filelist /etc/duply/photost/exclude
> Main action: inc
> ================================================================================
> duplicity 0.7.06 ($reldate)
> Args: /usr/bin/duplicity --archive-dir /home/billsrv/duplicity --name 
> duply_photost --verbosity 9 --full-if-older-than 6M --volsize 128 
> --file-prefix 
> photost_Brook_Scan --name photost_Brook_Scan --exclude-filelist 
> /etc/duply/photost/exclude /photost/Brook_Scan 
> gdocs://address@hidden//photost/Brook_Scan
> Linux bixserver.thebix 3.2.0-97-generic #137-Ubuntu SMP Thu Dec 17 18:11:47 
> UTC 2015 x86_64 x86_64
> /usr/bin/python2 2.7.3 (default, Jun 22 2015, 19:33:41) 
> [GCC 4.6.3]
> ================================================================================
> Using temporary directory /tmp/duplicity-GiVXej-tempdir
> Registering (mkstemp) temporary file /tmp/duplicity-GiVXej-tempdir/mkstemp-
> BrBjdg-1
> Temp has 9640005632 available, backup will use approx 174483046.
> Local and Remote metadata are synchronized, no sync needed.
> 0 files exist on backend
> 2 files exist in cache
> Extracting backup chains from list of files: []
> Last full backup date: none
> Last full backup is too old, forcing full backup
> Collection Status
> -----------------
> Connecting with backend: BackendWrapper
> Archive dir: /home/billsrv/duplicity/photost_Brook_Scan
> 
> Found 0 secondary backup chains.
> No backup chains with active signatures found
> No orphaned or incomplete backup sets found.
> Using temporary directory 
> /home/billsrv/duplicity/photost_Brook_Scan/duplicity-M7auRh-tempdir
> Registering (mktemp) temporary file 
> /home/billsrv/duplicity/photost_Brook_Scan/duplicity-M7auRh-tempdir/mktemp-
> kJ9Qh6-1
> Releasing lockfile /home/billsrv/duplicity/photost_Brook_Scan/lockfile.lock
> Removing still remembered temporary file 
> /tmp/duplicity-GiVXej-tempdir/mkstemp-
> BrBjdg-1
> Removing still remembered temporary file 
> /home/billsrv/duplicity/photost_Brook_Scan/duplicity-M7auRh-tempdir/mktemp-
> kJ9Qh6-1
> --- Finished state FAILED 'code 30' at 13:54:25.133 - Runtime 00:00:02.063 ---
> 
> The error log from Duplicity:
> Traceback (most recent call last):
>   File "/usr/bin/duplicity", line 1532, in <module>
>     with_tempdir(main)
>   File "/usr/bin/duplicity", line 1526, in with_tempdir
>     fn()
>   File "/usr/bin/duplicity", line 1380, in main
>     do_backup(action)
>   File "/usr/bin/duplicity", line 1496, in do_backup
>     full_backup(col_stats)
>   File "/usr/bin/duplicity", line 561, in full_backup
>     sig_outfp = get_sig_fileobj("full-sig")
>   File "/usr/bin/duplicity", line 530, in get_sig_fileobj
>     overwrite=True)
>   File "/usr/lib/python2.7/dist-packages/duplicity/dup_temp.py", line 75, in 
> get_fileobj_duppath
>     tdp = TempDupPath(tdpname, parseresults=file_naming.parse(partname))
>   File "/usr/lib/python2.7/dist-packages/duplicity/path.py", line 748, in 
> __init__
>     assert len(index) == 1
> AssertionError
> 
> 13:54:25.133 Task 'BKP' failed with exit code '30'.
> 
> On another directory with all lower cxase name the Duply log show Duplicity 
> happy:
> Start duply v1.5.5.4, time is 2015-12-26 13:54:25.
> Using profile '/etc/duply/photost'.
> Using installed duplicity version 0.7.06, python 2.7.3, gpg 1.4.11 (Home: 
> ~/.gnupg), awk 'GNU Awk 3.1.8', bash '4.2.25(1)-release (x86_64-pc-linux-
> gnu)'.
> Signing disabled. Not GPG_KEY entries in config.
> Test - Encryption with passphrase (OK)
> Test - Decryption with passphrase (OK)
> Test - Compare (OK)
> Cleanup - Delete '/tmp/duply.14970.1451156065_*'(OK)
> 
> --- Start running command BKP at 13:54:25.523 ---
> Using archive dir: /home/billsrv/duplicity/photost_celtics_wallpaper
> Using backup name: photost_celtics_wallpaper
> Import of duplicity.backends.azurebackend Succeeded
> Import of duplicity.backends.b2backend Succeeded
> Import of duplicity.backends.botobackend Succeeded
> Import of duplicity.backends.cfbackend Succeeded
> Import of duplicity.backends.copycombackend Succeeded
> Import of duplicity.backends.dpbxbackend Succeeded
> Import of duplicity.backends.gdocsbackend Succeeded
> Import of duplicity.backends.giobackend Succeeded
> Import of duplicity.backends.hsibackend Succeeded
> Import of duplicity.backends.hubicbackend Succeeded
> Import of duplicity.backends.imapbackend Succeeded
> Import of duplicity.backends.lftpbackend Succeeded
> Import of duplicity.backends.localbackend Succeeded
> Import of duplicity.backends.megabackend Succeeded
> Import of duplicity.backends.multibackend Succeeded
> Import of duplicity.backends.ncftpbackend Succeeded
> Import of duplicity.backends.onedrivebackend Succeeded
> Import of duplicity.backends.par2backend Succeeded
> Import of duplicity.backends.pydrivebackend Succeeded
> Import of duplicity.backends.rsyncbackend Succeeded
> Import of duplicity.backends.ssh_paramiko_backend Succeeded
> Import of duplicity.backends.ssh_pexpect_backend Succeeded
> Import of duplicity.backends.swiftbackend Succeeded
> Import of duplicity.backends.sxbackend Succeeded
> Import of duplicity.backends.tahoebackend Succeeded
> Import of duplicity.backends.webdavbackend Succeeded
> Reading globbing filelist /etc/duply/photost/exclude
> Main action: inc
> ================================================================================
> duplicity 0.7.06 ($reldate)
> Args: /usr/bin/duplicity --archive-dir /home/billsrv/duplicity --name 
> duply_photost --verbosity 9 --full-if-older-than 6M --volsize 128 
> --file-prefix 
> photost_celtics_wallpaper --name photost_celtics_wallpaper --exclude-filelist 
> /etc/duply/photost/exclude /photost/celtics_wallpaper 
> gdocs://address@hidden//photost/celtics_wallpaper
> Linux bixserver.thebix 3.2.0-97-generic #137-Ubuntu SMP Thu Dec 17 18:11:47 
> UTC 2015 x86_64 x86_64
> /usr/bin/python2 2.7.3 (default, Jun 22 2015, 19:33:41) 
> [GCC 4.6.3]
> ================================================================================
> Using temporary directory /tmp/duplicity-_BcIAE-tempdir
> Registering (mkstemp) temporary file /tmp/duplicity-_BcIAE-tempdir/mkstemp-
> _Z4jbQ-1
> Temp has 9640005632 available, backup will use approx 174483046.
> Local and Remote metadata are synchronized, no sync needed.
> 0 files exist on backend
> 2 files exist in cache
> Extracting backup chains from list of files: []
> Last full backup date: none
> Last full backup is too old, forcing full backup
> Collection Status
> -----------------
> Connecting with backend: BackendWrapper
> Archive dir: /home/billsrv/duplicity/photost_celtics_wallpaper
> 
> Found 0 secondary backup chains.
> No backup chains with active signatures found
> No orphaned or incomplete backup sets found.
> Using temporary directory 
> /home/billsrv/duplicity/photost_celtics_wallpaper/duplicity-3MycoX-tempdir
> Registering (mktemp) temporary file 
> /home/billsrv/duplicity/photost_celtics_wallpaper/duplicity-3MycoX-
> tempdir/mktemp-q1OYG5-1
> Using temporary directory 
> /home/billsrv/duplicity/photost_celtics_wallpaper/duplicity-A5Ymbm-tempdir
> Registering (mktemp) temporary file 
> /home/billsrv/duplicity/photost_celtics_wallpaper/duplicity-A5Ymbm-
> tempdir/mktemp-2oQ6zI-1
> AsyncScheduler: instantiating at concurrency 0
> Registering (mktemp) temporary file /tmp/duplicity-_BcIAE-tempdir/mktemp-
> Xs1ZyC-2
> Selecting /photost/celtics_wallpaper
> Comparing . and None
> Getting delta of (. dir) and None
> A .
> Selection: examining path /photost/celtics_wallpaper/.thumbcache
> Selection:     + no selection functions found. Including
> Selecting /photost/celtics_wallpaper/.thumbcache
> Comparing .thumbcache and None
> Getting delta of (.thumbcache dir) and None
> A .thumbcache
> Selection: examining path 
> /photost/celtics_wallpaper/.thumbcache/celts_bullseye_pierce_1024.jpg.jpg
> Selection:     + no selection functions found. Including
> Selecting 
> /photost/celtics_wallpaper/.thumbcache/celts_bullseye_pierce_1024.jpg.jpg
> Comparing .thumbcache/celts_bullseye_pierce_1024.jpg.jpg and None
> Getting delta of (.thumbcache/celts_bullseye_pierce_1024.jpg.jpg reg) and None
> A .thumbcache/celts_bullseye_pierce_1024.jpg.jpg
> Selection: examining path 
> /photost/celtics_wallpaper/.thumbcache/celts_bullseye_pierce_1600.jpg.jpg
> Selection:     + no selection functions found. Including
> Selecting 
> /photost/celtics_wallpaper/.thumbcache/celts_bullseye_pierce_1600.jpg.jpg
> Comparing .thumbcache/celts_bullseye_pierce_1600.jpg.jpg and None
> Getting delta of (.thumbcache/celts_bullseye_pierce_1600.jpg.jpg reg) and None
> 
> And so on for the files.
> It ends wi9th:
> Removing still remembered temporary file 
> /home/billsrv/duplicity/photost_celtics_wallpaper/duplicity-3MycoX-
> tempdir/mktemp-q1OYG5-1
> Removing still remembered temporary file 
> /home/billsrv/duplicity/photost_celtics_wallpaper/duplicity-A5Ymbm-
> tempdir/mktemp-2oQ6zI-1
> AsyncScheduler: running task synchronously (asynchronicity disabled)
> Writing photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.vol1.difftar.gpg
> PyDrive backend: file 'photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.vol1.difftar.gpg' not found in cache or on server
> PyDrive backend: creating new file 'photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.vol1.difftar.gpg'
> PyDrive backend: found file 'photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.vol1.difftar.gpg' with id 0B-6gtxbGBdCPcFVXaVdQU05NVG8 
> in ID cache
> Deleting /tmp/duplicity-_BcIAE-tempdir/mktemp-Xs1ZyC-2
> Forgetting temporary file /tmp/duplicity-_BcIAE-tempdir/mktemp-Xs1ZyC-2
> AsyncScheduler: task completed successfully
> Processed volume 1
> Writing photost_celtics_wallpaperduplicity-full-
> signatures.20151226T185426Z.sigtar.gpg
> PyDrive backend: file 'photost_celtics_wallpaperduplicity-full-
> signatures.20151226T185426Z.sigtar.gpg' not found in cache or on server
> PyDrive backend: creating new file 'photost_celtics_wallpaperduplicity-full-
> signatures.20151226T185426Z.sigtar.gpg'
> Deleting 
> /home/billsrv/duplicity/photost_celtics_wallpaper/photost_celtics_wallpaperduplicity-
> full-signatures.20151226T185426Z.sigtar.gpg
> Writing photost_celtics_wallpaperduplicity-full.20151226T185426Z.manifest.gpg
> PyDrive backend: file 'photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.manifest.gpg' not found in cache or on server
> PyDrive backend: creating new file 'photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.manifest.gpg'
> Deleting 
> /home/billsrv/duplicity/photost_celtics_wallpaper/photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.manifest.gpg
> 3 files exist on backend
> 4 files exist in cache
> Extracting backup chains from list of files: 
> [u'photost_celtics_wallpaperduplicity-full.20151226T185426Z.manifest.gpg', 
> u'photost_celtics_wallpaperduplicity-full-
> signatures.20151226T185426Z.sigtar.gpg', u'photost_celtics_wallpaperduplicity-
> full.20151226T185426Z.vol1.difftar.gpg']
> File photost_celtics_wallpaperduplicity-full.20151226T185426Z.manifest.gpg is 
> not part of a known set; creating new set
> File photost_celtics_wallpaperduplicity-full-
> signatures.20151226T185426Z.sigtar.gpg is not part of a known set; creating 
> new set
> Ignoring file (rejected by backup set) 'photost_celtics_wallpaperduplicity-
> full-signatures.20151226T185426Z.sigtar.gpg'
> File 
> photost_celtics_wallpaperduplicity-full.20151226T185426Z.vol1.difftar.gpg 
> is part of known set
> Found backup chain [Sat Dec 26 13:54:26 2015]-[Sat Dec 26 13:54:26 2015]
> --------------[ Backup Statistics ]--------------
> StartTime 1451156067.12 (Sat Dec 26 13:54:27 2015)
> EndTime 1451156067.38 (Sat Dec 26 13:54:27 2015)
> ElapsedTime 0.26 (0.26 seconds)
> SourceFiles 20
> SourceFileSize 3948327 (3.77 MB)
> NewFiles 20
> NewFileSize 3948327 (3.77 MB)
> DeletedFiles 0
> ChangedFiles 
> ChangedFileSize 0 (0 bytes)
> ChangedDeltaSize 0 (0 bytes)
> DeltaEntries 20
> RawDeltaSize 3940135 (3.76 MB)
> TotalDestinationSizeChange 3906741 (3.73 MB)
> Errors 0
> -------------------------------------------------
> 
> Releasing lockfile 
> /home/billsrv/duplicity/photost_celtics_wallpaper/lockfile.lock
> Removing still remembered temporary file 
> /tmp/duplicity-_BcIAE-tempdir/mkstemp-
> _Z4jbQ-1
> --- Finished state OK at 13:54:43.664 - Runtime 00:00:18.141 ---
> 
> 

sorry, but your output is _incomplete_ . please try again in full length, 
uncut. you may zip or pastebin it, if it get's huge.

..ede/duply.net