Re: [rdiff-backup-users] Are my backups too corrupted to recover?

[Greg Freemyer]

Andrew, any info for me.

Even, I'm too busy to look at it for a few weeks would be useful.  I
need to get this fixed, or give up and restart my backups from
scratch.

Thanks
Greg

On Tue, Apr 7, 2009 at 6:36 PM, Greg Freemyer <address@hidden> wrote:
> Andrew,
>
> Anything else I can send you on this.  Do you think your going to get
> a fix in the next week or so?
>
> If not, I may just wipe out my backup repository and restart.  Been
> going without backups for a few weeks now.  (Mostly because I was too
> busy to look into why they were failing.)
>
> Greg
>
> On Fri, Apr 3, 2009 at 4:59 PM, Greg Freemyer <address@hidden> wrote:
>> All,
>>
>> I sent the listings directly to Andrew and Josh.
>>
>> The rdiff-backup -v8 output is inline here:
>>
>> ==
>> Using rdiff-backup version 1.2.6
>> Unable to import module xattr.
>> Extended attributes not supported on filesystem at /data
>> Unable to import module posix1e from pylibacl package.
>> POSIX ACLs not supported on filesystem at /data
>> Unable to import win32security module. Windows ACLs
>> not supported by filesystem at /data
>> escape_dos_devices not required by filesystem at /data
>> -----------------------------------------------------------------
>> Detected abilities for source (read only) file system:
>>  Access control lists                         Off
>>  Extended attributes                          Off
>>  Windows access control lists                 Off
>>  Case sensitivity                             On
>>  Escape DOS devices                           Off
>>  Escape trailing spaces                       Off
>>  Mac OS X style resource forks                Off
>>  Mac OS X Finder information                  Off
>> -----------------------------------------------------------------
>> Making directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/5-_
>> a.snapshot.gz
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/5-_
>> a.snapshot.gz
>> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
>> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/:\"
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/:\"
>> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/A
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/A
>> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/foo
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/foo
>> Making directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hl
>> Touching 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
>> Hard linking 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
>> to /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
>> Unable to import module xattr.
>> Extended attributes not supported on filesystem at
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> Unable to import module posix1e from pylibacl package.
>> POSIX ACLs not supported on filesystem at
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> Unable to import win32security module. Windows ACLs
>> not supported by filesystem at
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> Touching 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
>> Deleting 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
>> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/regfile
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/regfile
>> Touching 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
>> Touching 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
>> Deleting 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
>> Deleting 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
>> Touching 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
>> Deleting 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
>> Deleting 
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
>> escape_dos_devices not required by filesystem at
>> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> Removing directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
>> -----------------------------------------------------------------
>> Detected abilities for destination (read/write) file system:
>>  Ownership changing                           On
>>  Hard linking                                 On
>>  fsync() directories                          On
>>  Directory inc permissions                    On
>>  High-bit permissions                         On
>>  Symlink permissions                          Off
>>  Extended filenames                          Previous backup seems to
>> have failed, regressing destination now.
>> Exception 'Bad index order: ('long_filename_data', '1') >= ('Common
>> Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
>> 'norcrossgroupnotepad(1).pdf')' raised of class '<type
>> 'exceptions.AssertionError'>':
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 304, in error_check_Main
>>    try: Main(arglist)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 324, in Main
>>    take_action(rps)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 280, in take_action
>>    elif action == "backup": Backup(rps[0], rps[1])
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 337, in Backup
>>    backup_final_init(rpout)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 497, in backup_final_init
>>    checkdest_if_necessary(rpout)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 905, in checkdest_if_necessary
>>    dest_rp.conn.regress.Regress(dest_rp)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/regress.py",
>> line 71, in Regress
>>    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/rorpiter.py",
>> line 275, in __call__
>>    assert 0, "Bad index order: %s >= %s" % (self.index, index)
>>
>>  On
>>  Windows reserved filenames                   Off
>>  Access control lists                         Off
>>  Extended attributes                          Off
>>  Windows access control lists                 Off
>>  Case sensitivity                             On
>>  Escape DOS devices                           Off
>>  Escape trailing spaces                       Off
>>  Mac OS X style resource forks                Off
>>  Mac OS X Finder information                  Off
>> -----------------------------------------------------------------
>> Backup: must_escape_dos_devices = 0
>> Regressing to Wed Mar  4 19:36:32 2009
>> Restoring with increment base 1 for file Common Files/Copy of
>> Goldmine/MailBox/Attach/bhw/myel patentee desecrater adore suffolk
>> immediate vineyard sycophantictomb twirly bloody clara carbohydrate
>> procrustes greece stanza drophead demitting plaintive solicitation
>> aspersion callous .gif
>> Traceback (most recent call last):
>>  File "/usr/bin/rdiff-backup", line 30, in <module>
>>    rdiff_backup.Main.error_check_Main(sys.argv[1:])
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 304, in error_check_Main
>>    try: Main(arglist)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 324, in Main
>>    take_action(rps)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 280, in take_action
>>    elif action == "backup": Backup(rps[0], rps[1])
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 337, in Backup
>>    backup_final_init(rpout)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 497, in backup_final_init
>>    checkdest_if_necessary(rpout)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
>> 905, in checkdest_if_necessary
>>    dest_rp.conn.regress.Regress(dest_rp)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/regress.py",
>> line 71, in Regress
>>    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
>>  File "/usr/lib/python2.6/site-packages/rdiff_backup/rorpiter.py",
>> line 275, in __call__
>>    assert 0, "Bad index order: %s >= %s" % (self.index, index)
>> AssertionError: Bad index order: ('long_filename_data', '1') >=
>> ('Common Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
>> 'norcrossgroupnotepad(1).pdf')
>> ==
>> Greg
>> On Fri, Apr 3, 2009 at 4:52 PM, Greg Freemyer <address@hidden> wrote:
>>> Andrew/Josh,
>>>
>>> They are attached.  About 3MB total.  I did   not compress it, hope
>>> you've got a fast link.
>>>
>>> You both seemed interested.  No need send something this big to the whole 
>>> list.
>>>
>>> Greg
>>>
>>> On Wed, Apr 1, 2009 at 1:44 PM, Andrew Ferguson <address@hidden> wrote:
>>>>
>>>> On Apr 1, 2009, at 1:07 PM, Greg Freemyer wrote:
>>>>
>>>>> I was shuffling things around and may have broke my backup directory.
>>>>> I would like to recover it if it can be done relatively easily.
>>>>>
>>>>> Any clue how to restore functionality short of destroying my backup
>>>>> directory and recreating it?
>>>>>
>>>>> See results below
>>>>>
>>>>> # rdiff-backup --version
>>>>> rdiff-backup 1.2.6
>>>>>
>>>>> + rdiff-backup -v5 --print-statistics --exclude /data/EDD-Batches
>>>>> /data //backup/data-rdiff
>>>>>
>>>>> Previous backup seems to have failed, regressing destination now.
>>>>> Exception 'Bad index order: ('long_filename_data', '1') >= ('Common
>>>>> Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
>>>>> 'norcrossgroupnotepad(1).pdf')' raised of class '<type
>>>>> 'exceptions.AssertionError'>':
>>>>
>>>> Hmm, interesting. I was just thinking about this bug the other day and
>>>> hoping to figure it out.
>>>>
>>>> Can you send me:
>>>>
>>>> The complete output of:
>>>>
>>>> $ rdiff-backup -v8 --print-statistics --exclude /data/EDD-Batches /data
>>>> //backup/data-rdiff
>>>>
>>>> Recursive directory listing of:
>>>> /data/Common Files/Copy of Goldmine/MailBox/Attach/
>>>> /backup/data-rdiff/Common Files/Copy of Goldmine/Mailbox/Attach/
>>>>
>>>> plus the listing of /backup/data-rdiff/ and
>>>> /backup/data-rdiff/rdiff-backup-data/
>>>>
>>>>
>>>> Thanks!
>>>>
>>>>
>>>> Andrew
>>>>
>>>
>>>
>>>
>>> --
>>> Greg Freemyer
>>> Head of EDD Tape Extraction and Processing team
>>> Litigation Triage Solutions Specialist
>>> http://www.linkedin.com/in/gregfreemyer
>>> First 99 Days Litigation White Paper -
>>> http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
>>>
>>> The Norcross Group
>>> The Intersection of Evidence & Technology
>>> http://www.norcrossgroup.com
>>>
>>
>>
>>
>> --
>> Greg Freemyer
>> Head of EDD Tape Extraction and Processing team
>> Litigation Triage Solutions Specialist
>> http://www.linkedin.com/in/gregfreemyer
>> First 99 Days Litigation White Paper -
>> http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
>>
>> The Norcross Group
>> The Intersection of Evidence & Technology
>> http://www.norcrossgroup.com
>>
>
>
>
> --
> Greg Freemyer
> Head of EDD Tape Extraction and Processing team
> Litigation Triage Solutions Specialist
> http://www.linkedin.com/in/gregfreemyer
> First 99 Days Litigation White Paper -
> http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
>
> The Norcross Group
> The Intersection of Evidence & Technology
> http://www.norcrossgroup.com
>



-- 
Greg Freemyer
Head of EDD Tape Extraction and Processing team
Litigation Triage Solutions Specialist
http://www.linkedin.com/in/gregfreemyer
First 99 Days Litigation White Paper -
http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf

The Norcross Group
The Intersection of Evidence & Technology
http://www.norcrossgroup.com