rdiff-backup-users
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[rdiff-backup-users] IOError: [Errno 75] Value too large for defined dat

From: Bruno Basilio
Subject: [rdiff-backup-users] IOError: [Errno 75] Value too large for defined data type
Date: Tue, 10 May 2011 16:21:16 +0100 
Hi,

I'm new at using rdiff-backup but already fascinated with the simple principle.
Hope it will not stop to be maintained.

I'm running Ubuntu 10.04, installed the rdiff-backup 1.2.8 and tried
to backup 80GB of pictures and movies using to USB external drives
with NTFS, at around 30GB, it stopped with following error:

<<<
$  rdiff-backup -v9 --print-statistics --no-hard-links
/media/BBasilioHomeBackup/fotos/ /media/Elements/rdiff-backup/fotos/
Mon May  9 22:23:34 2011  Using rdiff-backup version 1.2.8
Mon May  9 22:23:34 2011  Found interrupted initial backup. Removing...
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08/2009_08_08
- Bruno
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:23:34 2011  Removing directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/backup.log
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/chars_to_quote
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/file_statistics.2011-05-09T22:20:28+01:00.data.gz
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/mirror_metadata.2011-05-09T22:20:28+01:00.snapshot.gz
Mon May  9 22:23:34 2011  POSIX ACLs not supported by filesystem at
/media/BBasilioHomeBackup/fotos
Mon May  9 22:23:34 2011  Unable to import win32security module. Windows ACLs
not supported by filesystem at /media/BBasilioHomeBackup/fotos
Mon May  9 22:23:34 2011  escape_dos_devices not required by
filesystem at /media/BBasilioHomeBackup/fotos
Mon May  9 22:23:34 2011
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         Off
  Extended attributes                          On
  Windows access control lists                 Off
  Case sensitivity                             On
  Escape DOS devices                           Off
  Escape trailing spaces                       Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Mon May  9 22:23:34 2011  Making directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/A
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/A
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/foo
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/foo
Mon May  9 22:23:34 2011  Making directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hl
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Mon May  9 22:23:34 2011  Hard linking
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
to 
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Mon May  9 22:23:34 2011  POSIX ACLs not supported by filesystem at
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Unable to import win32security module. Windows ACLs
not supported by filesystem at
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Mon May  9 22:23:34 2011  escape_dos_devices not required by
filesystem at 
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Removing directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
  Ownership changing                           Off
  Hard linking                                 On
  fsync() directories                          On
  Directory inc permissions                    Off
  High-bit permissions                         On
  Symlink permissions                          Off
  Extended filenames                           On
  Windows reserved filenames                   Off
  Access control lists                         Off
  Extended attributes                          On
  Windows access control lists                 Off
  Case sensitivity                             On
  Escape DOS devices                           Off
  Escape trailing spaces                       Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Mon May  9 22:23:34 2011  Backup: must_escape_dos_devices = 0
Mon May  9 22:23:34 2011  Starting mirror
/media/BBasilioHomeBackup/fotos to /media/Elements/rdiff-backup/fotos
Mon May  9 22:23:34 2011  Processing changed file .
Mon May  9 22:24:00 2011  Processing changed file 2009
Mon May  9 22:24:00 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:24:09 2011  Processing changed file 2009/2009_08_08
Mon May  9 22:24:09 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009
Mon May  9 22:24:09 2011  Processing changed file
2009/2009_08_08/2009_08_08 - Bruno
Mon May  9 22:24:09 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
- Benfica
Mon May  9 22:24:09 2011  Processing changed file 2009/2009_08_08 -
Benfica/2009_08_08 - Bruno/P1030107.JPG
Mon May  9 22:24:09 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
- Benfica/2009_08_08 - Bruno
Mon May  9 22:24:09 2011  Regular copying ('2009', '2009_08_08 -
Benfica', '2009_08_08 - Bruno', 'P1030107.JPG') to
/media/Elements/rdiff-backup/fotos/2009/2009_08_08 -
Benfica/2009_08_08 - Bruno/rdiff-backup.tmp.2
Mon May  9 22:24:09 2011  Writing file object to
/media/Elements/rdiff-backup/fotos/2009/2009_08_08 -
Benfica/2009_08_08 - Bruno/rdiff-backup.tmp.2
Mon May  9 22:24:09 2011  Exception '[Errno 75] Value too large for
defined data type' raised of class '<type 'exceptions.IOError'>':
  File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line 32,
in check_common_error
    try: return function(*args)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 105, in copy
    if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 133,
in copy_reg_file
    return rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
1195, in write_from_fileobj
    copyfileobj(fp, outfp)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 62,
in copyfileobj
    inbuf = inputfp.read(blocksize)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 1415, in read
    def read(self, length = -1): return self.file.read(length)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47, in read
    buf = self.fileobj.read(length)

Mon May  9 22:24:09 2011  Exception '[Errno 75] Value too large for
defined data type' raised of class '<type 'exceptions.IOError'>':
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 304,
in error_check_Main
    try: Main(arglist)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 324, in Main
    take_action(rps)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 280,
in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 346, in Backup
    backup.Mirror(rpin, rpout)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 38, in Mirror
    DestS.patch(dest_rpath, source_diffiter)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 232, in patch
    ITR(diff.index, diff)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rorpiter.py", line
281, in __call__
    last_branch.fast_process(*args)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
529, in fast_process
    if self.patch_to_temp(mirror_rp, diff_rorp, tf):
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
553, in patch_to_temp
    result = self.patch_snapshot_to_temp(diff_rorp, new)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
582, in patch_snapshot_to_temp
    (diff_rorp, new))
  File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line 32,
in check_common_error
    try: return function(*args)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 105, in copy
    if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 133,
in copy_reg_file
    return rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
1195, in write_from_fileobj
    copyfileobj(fp, outfp)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 62,
in copyfileobj
    inbuf = inputfp.read(blocksize)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 1415, in read
    def read(self, length = -1): return self.file.read(length)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47, in read
    buf = self.fileobj.read(length)

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 30, in <module>
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 304,
in error_check_Main
    try: Main(arglist)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 324, in Main
    take_action(rps)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 280,
in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 346, in Backup
    backup.Mirror(rpin, rpout)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 38, in Mirror
    DestS.patch(dest_rpath, source_diffiter)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 232, in patch
    ITR(diff.index, diff)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rorpiter.py", line
281, in __call__
    last_branch.fast_process(*args)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
529, in fast_process
    if self.patch_to_temp(mirror_rp, diff_rorp, tf):
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
553, in patch_to_temp
    result = self.patch_snapshot_to_temp(diff_rorp, new)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
582, in patch_snapshot_to_temp
    (diff_rorp, new))
  File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line 32,
in check_common_error
    try: return function(*args)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 105, in copy
    if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 133,
in copy_reg_file
    return rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
1195, in write_from_fileobj
    copyfileobj(fp, outfp)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 62,
in copyfileobj
    inbuf = inputfp.read(blocksize)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 1415, in read
    def read(self, length = -1): return self.file.read(length)
  File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47, in read
    buf = self.fileobj.read(length)
IOError: [Errno 75] Value too large for defined data type
>>>

Search through the rdiff-backup-users Archives but couldn't find
any cue to solve the problem.

Search the net for similar information and it seems to be related with
python version before 2.2 and presently I'm using 2.6.5.
Follow some version information.

<<<
$ python --version
Python 2.6.5
$ rsync --version
rsync  version 3.0.7  protocol version 30
$ dpkg -l | grep rsync
ii  librsync1                                        0.9.7-7
                              rsync remote-delta algorithm library
ii  rsync                                            3.0.7-1ubuntu1.1
                              fast remote file copy program (like rcp)
>>>

Thank you for your time.

-- 
Best regards,
Bruno Basílio
reply via email to
[Prev in Thread] Current Thread [Next in Thread]