Re: [rdiff-backup-users] Are my backups too corrupted to recover?

[Greg Freemyer]

Andrew,

Anything else I can send you on this.  Do you think your going to get
a fix in the next week or so?

If not, I may just wipe out my backup repository and restart.  Been
going without backups for a few weeks now.  (Mostly because I was too
busy to look into why they were failing.)

Greg

On Fri, Apr 3, 2009 at 4:59 PM, Greg Freemyer <address@hidden> wrote:
> All,
>
> I sent the listings directly to Andrew and Josh.
>
> The rdiff-backup -v8 output is inline here:
>
> ==
> Using rdiff-backup version 1.2.6
> Unable to import module xattr.
> Extended attributes not supported on filesystem at /data
> Unable to import module posix1e from pylibacl package.
> POSIX ACLs not supported on filesystem at /data
> Unable to import win32security module. Windows ACLs
> not supported by filesystem at /data
> escape_dos_devices not required by filesystem at /data
> -----------------------------------------------------------------
> Detected abilities for source (read only) file system:
>  Access control lists                         Off
>  Extended attributes                          Off
>  Windows access control lists                 Off
>  Case sensitivity                             On
>  Escape DOS devices                           Off
>  Escape trailing spaces                       Off
>  Mac OS X style resource forks                Off
>  Mac OS X Finder information                  Off
> -----------------------------------------------------------------
> Making directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/5-_
> a.snapshot.gz
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/5-_
> a.snapshot.gz
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/:\"
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/:\"
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/A
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/A
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/foo
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/foo
> Making directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hl
> Touching 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
> Hard linking 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
> to /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
> Unable to import module xattr.
> Extended attributes not supported on filesystem at
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> Unable to import module posix1e from pylibacl package.
> POSIX ACLs not supported on filesystem at
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> Unable to import win32security module. Windows ACLs
> not supported by filesystem at
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
> Touching /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/regfile
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/regfile
> Touching 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
> Touching 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
> Deleting 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
> Deleting 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
> Touching 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
> Deleting 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
> Deleting 
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
> escape_dos_devices not required by filesystem at
> /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> Deleting /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> Removing directory /backup/data-rdiff/rdiff-backup-data/rdiff-backup.tmp.0
> -----------------------------------------------------------------
> Detected abilities for destination (read/write) file system:
>  Ownership changing                           On
>  Hard linking                                 On
>  fsync() directories                          On
>  Directory inc permissions                    On
>  High-bit permissions                         On
>  Symlink permissions                          Off
>  Extended filenames                          Previous backup seems to
> have failed, regressing destination now.
> Exception 'Bad index order: ('long_filename_data', '1') >= ('Common
> Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
> 'norcrossgroupnotepad(1).pdf')' raised of class '<type
> 'exceptions.AssertionError'>':
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 304, in error_check_Main
>    try: Main(arglist)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 324, in Main
>    take_action(rps)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 280, in take_action
>    elif action == "backup": Backup(rps[0], rps[1])
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 337, in Backup
>    backup_final_init(rpout)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 497, in backup_final_init
>    checkdest_if_necessary(rpout)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 905, in checkdest_if_necessary
>    dest_rp.conn.regress.Regress(dest_rp)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/regress.py",
> line 71, in Regress
>    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/rorpiter.py",
> line 275, in __call__
>    assert 0, "Bad index order: %s >= %s" % (self.index, index)
>
>  On
>  Windows reserved filenames                   Off
>  Access control lists                         Off
>  Extended attributes                          Off
>  Windows access control lists                 Off
>  Case sensitivity                             On
>  Escape DOS devices                           Off
>  Escape trailing spaces                       Off
>  Mac OS X style resource forks                Off
>  Mac OS X Finder information                  Off
> -----------------------------------------------------------------
> Backup: must_escape_dos_devices = 0
> Regressing to Wed Mar  4 19:36:32 2009
> Restoring with increment base 1 for file Common Files/Copy of
> Goldmine/MailBox/Attach/bhw/myel patentee desecrater adore suffolk
> immediate vineyard sycophantictomb twirly bloody clara carbohydrate
> procrustes greece stanza drophead demitting plaintive solicitation
> aspersion callous .gif
> Traceback (most recent call last):
>  File "/usr/bin/rdiff-backup", line 30, in <module>
>    rdiff_backup.Main.error_check_Main(sys.argv[1:])
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 304, in error_check_Main
>    try: Main(arglist)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 324, in Main
>    take_action(rps)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 280, in take_action
>    elif action == "backup": Backup(rps[0], rps[1])
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 337, in Backup
>    backup_final_init(rpout)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 497, in backup_final_init
>    checkdest_if_necessary(rpout)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/Main.py", line
> 905, in checkdest_if_necessary
>    dest_rp.conn.regress.Regress(dest_rp)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/regress.py",
> line 71, in Regress
>    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
>  File "/usr/lib/python2.6/site-packages/rdiff_backup/rorpiter.py",
> line 275, in __call__
>    assert 0, "Bad index order: %s >= %s" % (self.index, index)
> AssertionError: Bad index order: ('long_filename_data', '1') >=
> ('Common Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
> 'norcrossgroupnotepad(1).pdf')
> ==
> Greg
> On Fri, Apr 3, 2009 at 4:52 PM, Greg Freemyer <address@hidden> wrote:
>> Andrew/Josh,
>>
>> They are attached.  About 3MB total.  I did   not compress it, hope
>> you've got a fast link.
>>
>> You both seemed interested.  No need send something this big to the whole 
>> list.
>>
>> Greg
>>
>> On Wed, Apr 1, 2009 at 1:44 PM, Andrew Ferguson <address@hidden> wrote:
>>>
>>> On Apr 1, 2009, at 1:07 PM, Greg Freemyer wrote:
>>>
>>>> I was shuffling things around and may have broke my backup directory.
>>>> I would like to recover it if it can be done relatively easily.
>>>>
>>>> Any clue how to restore functionality short of destroying my backup
>>>> directory and recreating it?
>>>>
>>>> See results below
>>>>
>>>> # rdiff-backup --version
>>>> rdiff-backup 1.2.6
>>>>
>>>> + rdiff-backup -v5 --print-statistics --exclude /data/EDD-Batches
>>>> /data //backup/data-rdiff
>>>>
>>>> Previous backup seems to have failed, regressing destination now.
>>>> Exception 'Bad index order: ('long_filename_data', '1') >= ('Common
>>>> Files', 'Copy of Goldmine', 'MailBox', 'Attach', 'bhw',
>>>> 'norcrossgroupnotepad(1).pdf')' raised of class '<type
>>>> 'exceptions.AssertionError'>':
>>>
>>> Hmm, interesting. I was just thinking about this bug the other day and
>>> hoping to figure it out.
>>>
>>> Can you send me:
>>>
>>> The complete output of:
>>>
>>> $ rdiff-backup -v8 --print-statistics --exclude /data/EDD-Batches /data
>>> //backup/data-rdiff
>>>
>>> Recursive directory listing of:
>>> /data/Common Files/Copy of Goldmine/MailBox/Attach/
>>> /backup/data-rdiff/Common Files/Copy of Goldmine/Mailbox/Attach/
>>>
>>> plus the listing of /backup/data-rdiff/ and
>>> /backup/data-rdiff/rdiff-backup-data/
>>>
>>>
>>> Thanks!
>>>
>>>
>>> Andrew
>>>
>>
>>
>>
>> --
>> Greg Freemyer
>> Head of EDD Tape Extraction and Processing team
>> Litigation Triage Solutions Specialist
>> http://www.linkedin.com/in/gregfreemyer
>> First 99 Days Litigation White Paper -
>> http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
>>
>> The Norcross Group
>> The Intersection of Evidence & Technology
>> http://www.norcrossgroup.com
>>
>
>
>
> --
> Greg Freemyer
> Head of EDD Tape Extraction and Processing team
> Litigation Triage Solutions Specialist
> http://www.linkedin.com/in/gregfreemyer
> First 99 Days Litigation White Paper -
> http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf
>
> The Norcross Group
> The Intersection of Evidence & Technology
> http://www.norcrossgroup.com
>



-- 
Greg Freemyer
Head of EDD Tape Extraction and Processing team
Litigation Triage Solutions Specialist
http://www.linkedin.com/in/gregfreemyer
First 99 Days Litigation White Paper -
http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf

The Norcross Group
The Intersection of Evidence & Technology
http://www.norcrossgroup.com