rdiff-backup-users
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [rdiff-backup-users] rdiff-backup fails with acl

From: roland
Subject: Re: [rdiff-backup-users] rdiff-backup fails with acl
Date: Mon, 22 May 2006 11:11:21 +0200 


This rdiff-backup comes from Debian SARGE and version is 0.13.4
this is quite old. since debian is somewhat conservative, i would at least recommend updating to rdiff-backup-1.0.4 , which is the current stable version. 
very many bugs have been fixed since 0.13.4 (which is dated 2004/01/31)
I have cut this mail so that its size makes it acceptable in this mailing-list 
ditto! :)

regards
roland
----- Original Message ----- From: clavius 
To: roland
Cc: address@hidden
Sent: Monday, May 22, 2006 10:02 AM
Subject: Re: [rdiff-backup-users] rdiff-backup fails with acl


This rdiff-backup comes from Debian SARGE and version is 0.13.4
I will probably have to locate the origin of the problem in a particular folder in the source directory. This folder should contain something that make rdiff-backup produce inconsistency for futur backups
I have cut this mail so that its size makes it acceptable in this mailing-list 

Thank you

Le lundi 22 mai 2006 à 01:20 +0200, roland a écrit :


Hello clavius,


Thank you for your help.
you`re welcome - but please don`t think i´m a real rdiff-backup expert. i just want to _try_ to help, making it probably easier for other involved persons, too. 

pardon, but it seems we missed one essential question:

what exact version of rdiff-backup are you using ?

regards
roland
----- Original Message ----- From: clavius 
To: roland
Cc: address@hidden
Sent: Sunday, May 21, 2006 8:37 PM
Subject: Re: [rdiff-backup-users] rdiff-backup fails with acl


Hy Roland,

Thank you for your help.
Here is another test : I have removed the directory /data/groups/ciekivitasku/www and I have rebuilt the backup of /data from scratch. 


1 - Same as before : the first entire backup produces NO Error.
2 - but look at the output from the second command : rdiff-backup -v9 /data/ /backup/RDIFF-BACKUP/data 
   Something seems to be wrong with mode 'wb' and name 'uid'

Does this bring you more elements ?
Sun May 21 19:49:38 2006 Unable to import module xattr. EAs not supported on filesystem at /data Sun May 21 19:49:38 006 ----------------------------------------------------------------- 
Detected abilities for source (read only) file system:
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Sun May 21 19:49:38 2006 Making directory /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 19:49:38 2006 Touching /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0/foo 

...
Sun May 21 19:49:38 2006 Removing directory /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 19:49:38 006 ----------------------------------------------------------------- 
Detected abilities for destination (read/write) file system:
 Characters needing quoting                   ''
 Ownership changing                           On
 Hard linking                                 On
 fsync() directories                          On
 Directory inc permissions                    On
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Sun May 21 19:49:38 2006 Touching mirror marker /backup/RDIFF-BACKUP/data/rdiff-backup-data/current_mirror.2006-05-21T19:49:38+02:00.data Sun May 21 19:49:38 2006 Touching /backup/RDIFF-BACKUP/data/rdiff-backup-data/current_mirror.2006-05-21T19:49:38+02:00.data Sun May 21 19:49:38 2006 Starting increment operation /data to /backup/RDIFF-BACKUP/data 
Traceback (most recent call last):
 File "/usr/bin/rdiff-backup", line 23, in ?
   rdiff_backup.Main.Main(sys.argv[1:])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 260, in Main 
   take_action(rps)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 230, in take_action 
   elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 279, in Backup 
   backup.Mirror_and_increment(rpin, rpout, incdir)
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 51, in Mirror_and_increment 
   DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 225, in patch_and_increment 
   for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 173, in FillInIter 
   first_rp = rpiter.next() # StopIteration gets passed upwards
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 103, in get_diffs 
   for dest_sig in dest_sigiter:
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 165, in get_sigs 
   for src_rorp, dest_rorp in cls.CCPP:
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 299, in next 
   source_rorp, dest_rorp = self.iter.next()
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 100, in Collate2Iters 
   try: relem2 = riter2.next()
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 497, in helper 
   for rorp, acl in collated:
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 100, in Collate2Iters 
   try: relem2 = riter2.next()
File "/usr/lib/python2.3/site-packages/rdiff_backup/metadata.py", line 256, in iterate 
   try: yield self.record_to_object(self.buf[:next_pos])
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 475, in Record2ACL 
   return AccessControlLists(index, record[newline_pos:])
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 192, in __init__ 
   if acl_text: self.set_from_text(acl_text)
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 207, in set_from_text 
   else: self.entry_list.append(self.text_to_entrytuple(line))
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 247, in text_to_entrytuple 
   else: namepair = (uid, None)
NameError: global name 'uid' is not defined
Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/access_control_lists.2006-05-21T19:49:38+02:00.snapshot.gz', mode 'wb' at 0x40224b60 0x404f7f8c>> ignored Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/file_statistics.2006-05-21T19:49:38+02:00.data.gz', mode 'wb' at 0x402242e0 0x404f724c>> ignored Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/error_log.2006-05-21T19:49:38+02:00.data.gz', mode 'wb' at 0x40207ea0 0x404f5bcc>> ignored Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/mirror_metadata.2006-05-21T19:49:38+02:00.snapshot.gz', mode 'wb' at 0x402243e0 0x404f7f0c>> ignored 




Le dimanche 21 mai 2006 à 15:46 +0200, roland a écrit :


hello !
could you try creating (copyin and/or moving) /data/groups/ciekivitasku/www/htdocs/pics/kivitasku bandeau petit format.jpg to a different path (same or greater number of subdirs) and try backing up that single directory-tree including that single file? 

maybe we get a repro-case with this.
(the file has 3 whitespaces, that shouldn`t be a problem - but _maybe_ it is related to this) 

regards
roland
----- Original Message ----- From: clavius 
To: roland
Cc: address@hidden
Sent: Sunday, May 21, 2006 2:37 PM
Subject: Re: [rdiff-backup-users] rdiff-backup fails with acl
In fact the problem occurs again starting from the second (first non-empty increments) backup. 

Note : - Debian pachages for ACL & RDIFF-BACKUP had been reinstalled first

Details :
1 - After the complete backup destination directory has been deleted,
the 1st command 'rdiff-backup /data /backup/RDIFF-BACKUP/data' produces NO error.
2 - Problems come here, with a particular output for the second backup (option -v9 added) :
Sun May 21 14:29:09 2006 Unable to import module xattr. EAs not supported on filesystem at /data Sun May 21 14:29:09 006 ----------------------------------------------------------------- 
Detected abilities for source (read only) file system:
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Sun May 21 14:29:09 2006 Making directory /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 

..
Sun May 21 14:29:09 2006 Deleting /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 14:29:09 2006 Removing directory /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 14:29:09 006 ----------------------------------------------------------------- 
Detected abilities for destination (read/write) file system:
 Characters needing quoting                   ''
 Ownership changing                           On
 Hard linking                                 On
 fsync() directories                          On
 Directory inc permissions                    On
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Sun May 21 14:29:09 2006 Touching mirror marker /backup/RDIFF-BACKUP/data/rdiff-backup-data/current_mirror.2006-05-21T14:29:09+02:00.data Sun May 21 14:29:09 2006 Touching /backup/RDIFF-BACKUP/data/rdiff-backup-data/current_mirror.2006-05-21T14:29:09+02:00.data 


...
Sun May 21 14:29:09 2006 Copying inc attrs from ('groups', 'ciekivitasku', 'www', 'htdocs', 'pics', 'kivitasku bandeau petit format.jpg') to /backup/RDIFF-BACKUP/data/rdiff-backup-data/increments/groups/ciekivitasku/www/htdocs/pics/kivitasku bandeau petit format.jpg.2006-05-21T13:59:22+02:00.diff Sun May 21 14:29:09 2006 Setting time of /backup/RDIFF-BACKUP/data/rdiff-backup-data/increments/groups/ciekivitasku/www/htdocs/pics/kivitasku bandeau petit format.jpg.2006-05-21T13:59:22+02:00.diff to 1135892172 Sun May 21 14:29:09 2006 Renaming /backup/RDIFF-BACKUP/data/groups/ciekivitasku/www/htdocs/pics/rdiff-backup.tmp.3 to /backup/RDIFF-BACKUP/data/groups/ciekivitasku/www/htdocs/pics/kivitasku bandeau petit format.jpg 
Traceback (most recent call last):
 File "/usr/bin/rdiff-backup", line 23, in ?
   rdiff_backup.Main.Main(sys.argv[1:])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 260, in Main 
   take_action(rps)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 230, in take_action 
   elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 279, in Backup 
   backup.Mirror_and_increment(rpin, rpout, incdir)
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 51, in Mirror_and_increment 
   DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 225, in patch_and_increment 
   for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 181, in FillInIter 
   for rp in rpiter:
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 103, in get_diffs 
   for dest_sig in dest_sigiter:
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 165, in get_sigs 
   for src_rorp, dest_rorp in cls.CCPP:
File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line 299, in next 
   source_rorp, dest_rorp = self.iter.next()
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 100, in Collate2Iters 
   try: relem2 = riter2.next()
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 497, in helper 
   for rorp, acl in collated:
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 100, in Collate2Iters 
   try: relem2 = riter2.next()
File "/usr/lib/python2.3/site-packages/rdiff_backup/metadata.py", line 256, in iterate 
   try: yield self.record_to_object(self.buf[:next_pos])
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 475, in Record2ACL 
   return AccessControlLists(index, record[newline_pos:])
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 192, in __init__ 
   if acl_text: self.set_from_text(acl_text)
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 207, in set_from_text 
   else: self.entry_list.append(self.text_to_entrytuple(line))
File "/usr/lib/python2.3/site-packages/rdiff_backup/eas_acls.py", line 247, in text_to_entrytuple 
   else: namepair = (uid, None)
NameError: global name 'uid' is not defined
Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/access_control_lists.2006-05-21T14:29:09+02:00.snapshot.gz', mode 'wb' at 0x40224b60 0x404b932c>> ignored Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/file_statistics.2006-05-21T14:29:09+02:00.data.gz', mode 'wb' at 0x402242e0 0x404b944c>> ignored Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/error_log.2006-05-21T14:29:09+02:00.data.gz', mode 'wb' at 0x40207ee0 0x404f4f0c>> ignored Exception exceptions.TypeError: "'NoneType' object is not callable" in <bound method GzipFile.__del__ of <gzip open file '/backup/RDIFF-BACKUP/data/rdiff-backup-data/mirror_metadata.2006-05-21T14:29:09+02:00.snapshot.gz', mode 'wb' at 0x402243e0 0x404b94cc>> ignored 


3 - All next backups will produce the same output :
Sun May 21 14:29:25 2006 Previous backup seems to have failed, regressing destination now. Sun May 21 14:29:25 2006 Unable to import module xattr. EAs not supported on filesystem at /data Sun May 21 14:29:25 006 ----------------------------------------------------------------- 
Detected abilities for source (read only) file system:
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Sun May 21 14:29:25 2006 Making directory /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 14:29:25 2006 Touching /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0/foo 

...
Sun May 21 14:29:25 2006 Deleting /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0/¯ Sun May 21 14:29:25 2006 Deleting /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 14:29:25 2006 Removing directory /backup/RDIFF-BACKUP/data/rdiff-backup-data/rdiff-backup.tmp.0 Sun May 21 14:29:25 006 ----------------------------------------------------------------- 
Detected abilities for destination (read/write) file system:
 Characters needing quoting                   ''
 Ownership changing                           On
 Hard linking                                 On
 fsync() directories                          On
 Directory inc permissions                    On
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Sun May 21 14:29:25 2006  Regressing to Sun May 21 13:59:22 2006

...
Sun May 21 14:29:25 2006 Deleting /backup/RDIFF-BACKUP/data/rdiff-backup-data/increments/groups/ciekivitasku/www/htdocs/index.html~.2006-05-21T13:59:22+02:00.diff.gz Sun May 21 14:29:25 2006 Deleting increment /backup/RDIFF-BACKUP/data/rdiff-backup-data/increments/groups/ciekivitasku/www/htdocs/pics/kivitasku bandeau petit format.jpg.2006-05-21T13:59:22+02:00.diff Sun May 21 14:29:25 2006 Deleting /backup/RDIFF-BACKUP/data/rdiff-backup-data/increments/groups/ciekivitasku/www/htdocs/pics/kivitasku bandeau petit format.jpg.2006-05-21T13:59:22+02:00.diff Sun May 21 14:29:25 2006 Regressing attributes of /backup/RDIFF-BACKUP/data/groups/ciekivitasku/www/htdocs/pics Sun May 21 14:29:25 2006 Copying attributes from ('groups', 'ciekivitasku', 'www', 'htdocs', 'pics') to /backup/RDIFF-BACKUP/data/groups/ciekivitasku/www/htdocs/pics 
Traceback (most recent call last):
 File "/usr/bin/rdiff-backup", line 23, in ?
   rdiff_backup.Main.Main(sys.argv[1:])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 260, in Main 
   take_action(rps)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 230, in take_action 
   elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 274, in Backup 
   backup_final_init(rpout)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 365, in backup_final_init 
   checkdest_if_necessary(rpout)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 852, in checkdest_if_necessary 
   dest_rp.conn.regress.Regress(dest_rp)
File "/usr/lib/python2.3/site-packages/rdiff_backup/regress.py", line 70, in Regress 
   for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 275, in __call__ 
   if self.finish_branches(index) is None:
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 227, in finish_branches 
   to_be_finished.end_process()
File "/usr/lib/python2.3/site-packages/rdiff_backup/regress.py", line 282, in end_process 
   rpath.copy_attribs(rf.metadata_rorp, rf.mirror_rp)
File "/usr/lib/python2.3/site-packages/rdiff_backup/rpath.py", line 165, in copy_attribs 
   if Globals.acls_write: rpout.write_acl(rpin.get_acl())
File "/usr/lib/python2.3/site-packages/rdiff_backup/rpath.py", line 601, in get_acl 
   return self.data['acl']
KeyError: 'acl'


Le samedi 20 mai 2006 à 14:54 +0200, roland a écrit :


also add a "-v9" to your rdiff-backup command - this will probably show what rdiff-backup is doing before failing
----- Original Message ----- From: clavius 
To: address@hidden
Sent: Saturday, May 20, 2006 10:37 AM
Subject: [rdiff-backup-users] rdiff-backup fails with acl
I have used rdiff-backup on debian 3.1 with ACL successfully, since a few months but, I didnt find any user trying to solve the problem I have since a few days now. This failure completely freezes a daily backup process on an important server :
rdiff-backup fails on a partition mounted according to the associated fstab entry : 
#LVM
/dev/vg_data/lv_data /data ext2    defaults,noatime,acl 0 0


the rdiff-backup destination dir is in a partition described as :
#LVM
/dev/vg_backup/lv_backup /backup ext2    defaults,noatime,acl 0 0


I use the command : rdiff-backup /data /backup/RDIFF-BACKUP/data
and get this :
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
 Characters needing quoting                   ''
 Ownership changing                           On
 Hard linking                                 On
 fsync() directories                          On
 Directory inc permissions                    On
 Access control lists                         On
 Extended attributes                          Off
 Mac OS X style resource forks                Off
 Mac OS X Finder information                  Off
-----------------------------------------------------------------
Previous backup seems to have failed, regressing destination now.
Traceback (most recent call last):
 File "/usr/bin/rdiff-backup", line 23, in ?
   rdiff_backup.Main.Main(sys.argv[1:])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 260, in Main 
   take_action(rps)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 230, in take_action 
   elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 274, in Backup 
   backup_final_init(rpout)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 365, in backup_final_init 
   checkdest_if_necessary(rpout)
File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line 852, in checkdest_if_necessary 
   dest_rp.conn.regress.Regress(dest_rp)
File "/usr/lib/python2.3/site-packages/rdiff_backup/regress.py", line 70, in Regress 
   for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 275, in __call__ 
   if self.finish_branches(index) is None:
File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line 227, in finish_branches 
   to_be_finished.end_process()
File "/usr/lib/python2.3/site-packages/rdiff_backup/regress.py", line 282, in end_process 
   rpath.copy_attribs(rf.metadata_rorp, rf.mirror_rp)
File "/usr/lib/python2.3/site-packages/rdiff_backup/rpath.py", line 165, in copy_attribs 
   if Globals.acls_write: rpout.write_acl(rpin.get_acl())
File "/usr/lib/python2.3/site-packages/rdiff_backup/rpath.py", line 601, in get_acl 
   return self.data['acl']
KeyError: 'acl'

Thank you for your help.













_______________________________________________
rdiff-backup-users mailing list at address@hidden
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
reply via email to
[Prev in Thread] Current Thread [Next in Thread]