Re: [rdiff-backup-users] Curly braces in file names

[KP]

Dominic,

I added --exclude-regexp '[{}]+' after checking Spotlight to see if any vital files would be affected (not at the moment, but future files named with {} may be).  That worked, for the narrow test case of /Applications/Adobe.

Then I modified the backup script with that exclude, to target the root again, and upped -v to 9.  It skipped the {} file fine, but then a new problem: it hits a symlink and terminates (on /Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/AdobeACE ).

After reading other rdiff-backup-users threads on symlinks, I double-checked the timestamps of the symlink and its target file- identical, so it's not the future timestamp problem mentioned elsewhere.

Is there a cure for this symlink problem?

Kevin

~/bin/backup.sh:

rdiff-backup  --carbonfile -v9  \

--preserve-numerical-ids --include-special-files \

--exclude-other-filesystems --exclude-sockets \

--no-hard-links --include-symbolic-links \

--exclude-regexp '[{}]+' \

--exclude '/proc/*' --exclude '/cores/*' --exclude '/sys/*' --exclude '/tmp/*' \

--exclude '/.DocumentRevisions-V100/*' --exclude '/.Spotlight-V100/*' \

--exclude '/Users/kev/PicturesNew/*' --exclude '/Volumes/*' \

--exclude '/.Trashes/*' --exclude '/.file/*' --exclude '/.fseventsd/*' \

--exclude '/.vol/*' \

/ /Volumes/backups/main/

Output:

...

Fri May 17 12:00:04 2013  Processing changed file Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/AdobeACE

Fri May 17 12:00:04 2013  Making directory path /Volumes/backups/main/rdiff-backup-data/increments/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework

Fri May 17 12:00:04 2013  Regular copying ('Applications', 'Adobe Bridge CS6', 'Adobe Bridge CS6.app', 'Contents', 'Frameworks', 'AdobeACE.framework', 'AdobeACE') to /Volumes/backups/main/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/rdiff-backup.tmp.1238

Fri May 17 12:00:04 2013  Copying attributes from ('Applications', 'Adobe Bridge CS6', 'Adobe Bridge CS6.app', 'Contents', 'Frameworks', 'AdobeACE.framework', 'AdobeACE') to /Volumes/backups/main/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/rdiff-backup.tmp.1238

Fri May 17 12:00:04 2013  Renaming /Volumes/backups/main/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/rdiff-backup.tmp.1238 to /Volumes/backups/main/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/AdobeACE

Fri May 17 12:00:04 2013  Exception '[Errno 22] Invalid argument' raised of class '<type 'exceptions.OSError'>':

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/robust.py", line 32, in check_common_error

    try: return function(*args)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/rpath.py", line 260, in rename

    rp_source.conn.os.rename(rp_source.path, rp_dest.path)

Fri May 17 12:00:04 2013  Deleting /Volumes/backups/main/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/rdiff-backup.tmp.1238

Traceback (most recent call last):

  File "/opt/local/bin/rdiff-backup", line 30, in <module>

    rdiff_backup.Main.error_check_Main(sys.argv[1:])

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/Main.py", line 304, in error_check_Main

    try: Main(arglist)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/Main.py", line 324, in Main

    take_action(rps)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/Main.py", line 280, in take_action

    elif action == "backup": Backup(rps[0], rps[1])

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/Main.py", line 346, in Backup

    backup.Mirror(rpin, rpout)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/backup.py", line 38, in Mirror

    DestS.patch(dest_rpath, source_diffiter)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/backup.py", line 232, in patch

    ITR(diff.index, diff)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/rorpiter.py", line 281, in __call__

    last_branch.fast_process(*args)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/backup.py", line 535, in fast_process

    tf.delete()

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/rpath.py", line 1072, in delete

    try: self.conn.os.unlink(self.path)

OSError: [Errno 2] No such file or directory: '/Volumes/backups/main/Applications/Adobe Bridge CS6/Adobe Bridge CS6.app/Contents/Frameworks/AdobeACE.framework/rdiff-backup.tmp.1238'

On May 17, 2013, at 9:34 AM, KP wrote:

Dominic,

Ok.  I put the line in a bash script (and also changed from the fs root to the problem file's parent dir, just to get a result sooner).  Same result, it looks like.

Kevin

~/bin/backup.sh:

rdiff-backup  --carbonfile  \

--preserve-numerical-ids --include-special-files \

--exclude-other-filesystems --exclude-sockets \

--no-hard-links \

'/Applications/Adobe' /Volumes/backups/main/

$ sudo ~/bin/backup.sh 

OSError while renaming /Volumes/backups/main/AdobePatchFiles/ZipExceptions/{6944077E-F929-4772-B00E-E96C49B55DBA}/rdiff-backup.tmp.16 to /Volumes/backups/main/AdobePatchFiles/ZipExceptions/{6944077E-F929-4772-B00E-E96C49B55DBA}/030d3aadcd37ad6606cf8a1e71ba150e

UpdateError AdobePatchFiles/ZipExceptions/{6944077E-F929-4772-B00E-E96C49B55DBA}/rdiff-backup.tmp.16 [Errno 22] Invalid argument

Exception '[Errno 2] No such file or directory: '/Volumes/backups/main/AdobePatchFiles/ZipExceptions/{6944077E-F929-4772-B00E-E96C49B55DBA}/rdiff-backup.tmp.16'' raised of class '<type 'exceptions.OSError'>':

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/Main.py", line 304, in error_check_Main

    try: Main(arglist)

...

Traceback (most recent call last):

  File "/opt/local/bin/rdiff-backup", line 30, in <module>

    rdiff_backup.Main.error_check_Main(sys.argv[1:])

...

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/rdiff_backup/rpath.py", line 1072, in delete

    try: self.conn.os.unlink(self.path)

OSError: [Errno 2] No such file or directory: '/Volumes/backups/main/AdobePatchFiles/ZipExceptions/{6944077E-F929-4772-B00E-E96C49B55DBA}/rdiff-backup.tmp.16'

On May 17, 2013, at 3:25 AM, Dominic Raferd wrote:

Kevin:

Just to rule something out, try running it via a script, this way you can get rid of the sudo on the command line. I have known cases where sudo (under Ubuntu) causes strange behaviour with wildcards, not involving rdiff-backup but it is worth checking.

So save the command line without sudo as a file, make it executable and run it with sudo. At least it will rule out one possible cause...

Dominic

On 17/05/2013 10:21, KP wrote:

I neglected to include the Python error messages, see below.

My assumption about braces stemmed from advice read in other threads, that the last pathname prior to the error spill is generally worth checking out.

No other pathnames with curly braces were found in the log file, which contains about 1300 entries prior to the error.

Regards,

Kevin Prichard

...


On May 17, 2013, at 2:10 AM, KP wrote:

Hello all,

I am trying to use rdiff-backup.  Client is OS X 10.7.5, using v 1.2.8.  Backup host is NAS4Free, accessed via AFP, with ZFS raidz2 storage.

The trouble occurs when backing up /.  rdiff-backup stops on the following pathname-

Applications/Adobe/AdobePatchFiles/ZipExceptions/{6944077E-F929-4772-B00E-E96C49B55DBA}/030d3aadcd37ad6606cf8a1e71ba150e

Is there a cure for this?  I searched extensively before mailing the list, and saw other discussions regarding non-ASCII chars -- but didn't find one on curly braces (ASCII).

I'm invoking with the following-

$ sudo rdiff-backup  --preserve-numerical-ids --include-special-files \
--exclude-other-filesystems --exclude-sockets  --include-symbolic-links \
--exclude '/proc/*' --exclude '/cores/*' --exclude '/sys/*' --exclude '/tmp/*' \
--exclude '/.DocumentRevisions-V100/*' --exclude '/.Spotlight-V100/*' \
--exclude '/Users/kev/PicturesNew/*' --exclude '/Volumes/*' -v5 \
--exclude '/.Trashes/*' --exclude '/.file/*' --exclude '/.fseventsd/*' \
--exclude '/.vol/*' \
--include-regexp '[0-9a-zA-Z-_\.\(\){} \[\]]+' --exclude-regexp '[.]+' \
/ /Volumes/backups/main/ >> /tmp/rdiff7.log 2>&1 &


Also, a sanity check to ensure ZFS filenames allow '{}' did work.

Regards,
Kevin Prichard

--
TimeDicer: Free File Recovery from Whenever