[rdiff-backup-users] rdiff-backup seems to be "hanging up" on us

[Michael Hannon]

Greetings.  We're using rdiff-backup to do disk-to-disk backups over
a network between two x86_64 systems running Redhat 5 and rdiff-backup
version 1.0.5.

The total amount of data to be backed up is currently on the order of
700GB.

This seemed to be working nicely for weeks, but lately we've been
getting failures with tracebacks similar to the appended.

To the extent that I can decode the error messages, it appears that
there is a loss of connection between the two systems at some point.

On the other hand, we never observe any other network problems with
either of the two systems, so I am confused.

If you can shed any light on this, please let me know.

Thanks.

                                        - Mike

Starting mirror /home to /backup1/rd-yyyyy/xxxxxx/home
Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in ?
    rdiff_backup.Main.Main(sys.argv[1:])
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
285, in Main
    take_action(rps)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
255, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
308, in Backup
    backup.Mirror(rpin, rpout)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line
38, in Mirror
    DestS.patch(dest_rpath, source_diffiter)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 445, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 365, in reval
    result = self.get_response(req_num)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 314, in get_response
    try: req_num, object = self._get()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 228, in _get
    header_string = self.inpipe.read(9)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line
86, in signal_handler
    raise SignalException(signum)
rdiff_backup.robust.SignalException: 1
Exception 'Truncated header string (problem probably originated
remotely)' raised of class
'rdiff_backup.connection.ConnectionReadError':
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line
32, in check_common_error
    try: return function(*args)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
96, in copy
    if rpin.isreg(): copy_reg_file(rpin, rpout, compress)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
118, in copy_reg_file
    rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
978, in write_from_fileobj
    copyfileobj(fp, outfp)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
58, in copyfileobj
    inbuf = inputfp.read(blocksize)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1201, in read
    def read(self, length = -1): return self.file.read(length)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/iterfile.py",
line 117, in read
    if not self.addtobuffer(): break
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/iterfile.py",
line 132, in addtobuffer
    type, data = self.iwf._get()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/iterfile.py",
line 401, in _get
    if not self.buf: self.buf += self.file.read()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 513, in read
    return self.connection.VirtualFile.readfromid(self.id, length)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 445, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 365, in reval
    result = self.get_response(req_num)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 314, in get_response
    try: req_num, object = self._get()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 230, in _get
    raise ConnectionReadError("Truncated header string (problem "

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in ?
    rdiff_backup.Main.Main(sys.argv[1:])
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
285, in Main
    take_action(rps)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
253, in take_action
    connection.PipeConnection(sys.stdin, sys.stdout).Server()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 352, in Server
    self.get_response(-1)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 314, in get_response
    try: req_num, object = self._get()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/connection.py",
line 230, in _get
    raise ConnectionReadError("Truncated header string (problem "
rdiff_backup.connection.ConnectionReadError: Truncated header string
(problem probably originated remotely)
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/backup1/rd-yyyyy/xxxxxx/home/rdiff-backup-data/file_statistics.2007-09-28T13:36:23-07:00.data.gz',
mode 'wb' at 0x2aaab0217be8 0x2aaab0218d40>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/backup1/rd-yyyyy/xxxxxx/home/rdiff-backup-data/error_log.2007-09-28T13:36:23-07:00.data.gz',
mode 'wb' at 0x2aaab0217af8 0x2aaab0212b90>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/backup1/rd-yyyyy/xxxxxx/home/rdiff-backup-data/mirror_metadata.2007-09-28T13:36:23-07:00.snapshot.gz',
mode 'wb' at 0x2aaab0217d50 0x2aaab0218ea8>> ignored