Re: [rdiff-backup-users] Are my backups too corrupted to recover?

[Greg Freemyer]

All,

I sent the listings directly to Andrew and Josh.

The rdiff-backup -v8 output is inline here:

==
Using rdiff-backup version 1.2.6
Unable to import module xattr.
Extended attributes not supported on filesystem at /data
Unable to import module posix1e from pylibacl package.
POSIX ACLs not supported on filesystem at /data
Unable to import win32security module. Windows ACLs
not supported by filesystem at /data
escape_dos_devices not required by filesystem at /data
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         Off
  Extended attributes                          Off
  Windows access control lists                 Off
  Case sensitivity                             On
  Escape DOS devices                           Off
  Escape trailing spaces                       Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Making directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/A
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/A
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/foo
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/foo
Making directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hl
Touching 
/backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Hard linking 
/backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
to /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Unable to import module xattr.
Extended attributes not supported on filesystem at
/backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
Unable to import module posix1e from pylibacl package.
POSIX ACLs not supported on filesystem at
/backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
Unable to import win32security module. Windows ACLs
not supported by filesystem at
/backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
escape_dos_devices not required by filesystem at
/backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
Removing directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
  Ownership changing                           On
  Hard linking                                 On
  fsync() directories                          On
  Directory inc permissions                    On
  High-bit permissions                         On
  Symlink permissions                          Off
  Extended filenames                          Previous backup seems to
have failed, regressing destination now.
Exception 'Bad index order: ('long_filename_data', '1') >= ('Common
Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
'norcrossgroupnotepad(1).pdf')' raised of class '<type
'exceptions.AssertionError'>':
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
324, in Main
    take_action(rps)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
280, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
337, in Backup
    backup_final_init(rpout)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
497, in backup_final_init
    checkdest_if_necessary(rpout)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
905, in checkdest_if_necessary
    dest_rp.conn.regress.Regress(dest_rp)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/regress.py",
line 71, in Regress
    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/rorpiter.py",
line 275, in __call__
    assert 0, "Bad index order: %s >= %s" % (self.index, index)

 On
  Windows reserved filenames                   Off
  Access control lists                         Off
  Extended attributes                          Off
  Windows access control lists                 Off
  Case sensitivity                             On
  Escape DOS devices                           Off
  Escape trailing spaces                       Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Backup: must_escape_dos_devices = 0
Regressing to Wed Mar  4 19:36:32 2009
Restoring with increment base 1 for file Common Files/Copy of
Goldmine/MailBox/Attach/bhw/myel patentee desecrater adore suffolk
immediate vineyard sycophantictomb twirly bloody clara carbohydrate
procrustes greece stanza drophead demitting plaintive solicitation
aspersion callous .gif
Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 30, in <module>
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
324, in Main
    take_action(rps)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
280, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
337, in Backup
    backup_final_init(rpout)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
497, in backup_final_init
    checkdest_if_necessary(rpout)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
905, in checkdest_if_necessary
    dest_rp.conn.regress.Regress(dest_rp)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/regress.py",
line 71, in Regress
    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
  File "/usr/lib/python2.6/site-packages/rdiff_backup/rorpiter.py",
line 275, in __call__
    assert 0, "Bad index order: %s >= %s" % (self.index, index)
AssertionError: Bad index order: ('long_filename_data', '1') >=
('Common Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
'norcrossgroupnotepad(1).pdf')
==
Greg
On Fri, Apr 3, 2009 at 4:52 PM, Greg Freemyer <address@hidden> wrote:
> Andrew/Josh,
>
> They are attached.  About 3MB total.  I did   not compress it, hope
> you've got a fast link.
>
> You both seemed interested.  No need send something this big to the whole 
> list.
>
> Greg
>
> On Wed, Apr 1, 2009 at 1:44 PM, Andrew Ferguson <address@hidden> wrote:
>>
>> On Apr 1, 2009, at 1:07 PM, Greg Freemyer wrote:
>>
>>> I was shuffling things around and may have broke my backup directory.
>>> I would like to recover it if it can be done relatively easily.
>>>
>>> Any clue how to restore functionality short of destroying my backup
>>> directory and recreating it?
>>>
>>> See results below
>>>
>>> # rdiff-backup --version
>>> rdiff-backup 1.2.6
>>>
>>> + rdiff-backup -v5 --print-statistics --exclude /data/EDD-Batches
>>> /data //backup/data-rdiff
>>>
>>> Previous backup seems to have failed, regressing destination now.
>>> Exception 'Bad index order: ('long_filename_data', '1') >= ('Common
>>> Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
>>> 'norcrossgroupnotepad(1).pdf')' raised of class '<type
>>> 'exceptions.AssertionError'>':
>>
>> Hmm, interesting. I was just thinking about this bug the other day and
>> hoping to figure it out.
>>
>> Can you send me:
>>
>> The complete output of:
>>
>> $ rdiff-backup -v8 --print-statistics --exclude /data/EDD-Batches /data
>> //backup/data-rdiff
>>
>> Recursive directory listing of:
>> /data/Common Files/Copy of Goldmine/MailBox/Attach/
>> /backup/data-rdiff/Common Files/Copy of Goldmine/Mailbox/Attach/
>>
>> plus the listing of /backup/data-rdiff/ and
>> /backup/data-rdiff/rdiff-backup-data/
>>
>>
>> Thanks!
>>
>>
>> Andrew
>>
>
>
>
> --
> Greg Freemyer
> Head of EDD Tape Extraction and Processing team
> Litigation Triage Solutions Specialist
> http://www.linkedin.com/in/gregfreemyer
> First 99 Days Litigation White Paper -
> http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
>
> The Norcross Group
> The Intersection of Evidence & Technology
> http://www.norcrossgroup.com
>



-- 
Greg Freemyer
Head of EDD Tape Extraction and Processing team
Litigation Triage Solutions Specialist
http://www.linkedin.com/in/gregfreemyer
First 99 Days Litigation White Paper -
http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf

The Norcross Group
The Intersection of Evidence & Technology
http://www.norcrossgroup.com