[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [rdiff-backup-users] IOError: [Errno 75] Value too large for defined
|
From: |
D. Kriesel |
|
Subject: |
Re: [rdiff-backup-users] IOError: [Errno 75] Value too large for defined data type |
|
Date: |
Tue, 10 May 2011 21:45:54 +0200 |
>My
>impression is that a high proportion of problems with rdiff-backup
>relate to backups to NTFS volumes (backup *from* NTFS generally works
>fine).
Second that. If there is no unix file system available, fat32 is also an option.
David
>Dominic
>
>On 10/05/11 16:21, Bruno Basilio wrote:
>> Hi,
>>
>> I'm new at using rdiff-backup but already fascinated with the simple
>principle.
>> Hope it will not stop to be maintained.
>>
>> I'm running Ubuntu 10.04, installed the rdiff-backup 1.2.8 and tried
>> to backup 80GB of pictures and movies using to USB external drives
>> with NTFS, at around 30GB, it stopped with following error:
>>
>> <<<
>> $ rdiff-backup -v9 --print-statistics --no-hard-links
>> /media/BBasilioHomeBackup/fotos/ /media/Elements/rdiff-backup/fotos/
>> Mon May 9 22:23:34 2011 Using rdiff-backup version 1.2.8
>> Mon May 9 22:23:34 2011 Found interrupted initial backup.
>Removing...
>> Mon May 9 22:23:34 2011 Determining if directory contains files:
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
>> Mon May 9 22:23:34 2011 Determining if directory contains files:
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009
>> Mon May 9 22:23:34 2011 Determining if directory contains files:
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
>> Mon May 9 22:23:34 2011 Determining if directory contains files:
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08/2009_08_08
>> - Bruno
>> Mon May 9 22:23:34 2011 Deleting
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
>> Mon May 9 22:23:34 2011 Removing directory
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
>> Mon May 9 22:23:34 2011 Deleting
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/backup.log
>> Mon May 9 22:23:34 2011 Deleting
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/chars_to_quote
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/file_statistics.2011-05-09T22:20:28+01:00.data.gz
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/mirror_metadata.2011-05-09T22:20:28+01:00.snapshot.gz
>> Mon May 9 22:23:34 2011 POSIX ACLs not supported by filesystem at
>> /media/BBasilioHomeBackup/fotos
>> Mon May 9 22:23:34 2011 Unable to import win32security module.
>Windows ACLs
>> not supported by filesystem at /media/BBasilioHomeBackup/fotos
>> Mon May 9 22:23:34 2011 escape_dos_devices not required by
>> filesystem at /media/BBasilioHomeBackup/fotos
>> Mon May 9 22:23:34 2011
>> -----------------------------------------------------------------
>> Detected abilities for source (read only) file system:
>> Access control lists Off
>> Extended attributes On
>> Windows access control lists Off
>> Case sensitivity On
>> Escape DOS devices Off
>> Escape trailing spaces Off
>> Mac OS X style resource forks Off
>> Mac OS X Finder information Off
>> -----------------------------------------------------------------
>> Mon May 9 22:23:34 2011 Making directory
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/5-_
>> a.snapshot.gz
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/5-_
>> a.snapshot.gz
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/:\"
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/:\"
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/A
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/A
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/foo
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/foo
>> Mon May 9 22:23:34 2011 Making directory
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hl
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
>> Mon May 9 22:23:34 2011 Hard linking
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
>> to
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
>> Mon May 9 22:23:34 2011 POSIX ACLs not supported by filesystem at
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
>> Mon May 9 22:23:34 2011 Unable to import win32security module.
>Windows ACLs
>> not supported by filesystem at
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/regfile
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/regfile
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
>> Mon May 9 22:23:34 2011 Touching
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
>> Mon May 9 22:23:34 2011 escape_dos_devices not required by
>> filesystem at
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
>> Mon May 9 22:23:34 2011 Deleting
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
>> Mon May 9 22:23:34 2011 Removing directory
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
>> Mon May 9 22:23:34 2011
>> -----------------------------------------------------------------
>> Detected abilities for destination (read/write) file system:
>> Ownership changing Off
>> Hard linking On
>> fsync() directories On
>> Directory inc permissions Off
>> High-bit permissions On
>> Symlink permissions Off
>> Extended filenames On
>> Windows reserved filenames Off
>> Access control lists Off
>> Extended attributes On
>> Windows access control lists Off
>> Case sensitivity On
>> Escape DOS devices Off
>> Escape trailing spaces Off
>> Mac OS X style resource forks Off
>> Mac OS X Finder information Off
>> -----------------------------------------------------------------
>> Mon May 9 22:23:34 2011 Backup: must_escape_dos_devices = 0
>> Mon May 9 22:23:34 2011 Starting mirror
>> /media/BBasilioHomeBackup/fotos to /media/Elements/rdiff-backup/fotos
>> Mon May 9 22:23:34 2011 Processing changed file .
>> Mon May 9 22:24:00 2011 Processing changed file 2009
>> Mon May 9 22:24:00 2011 Making directory path
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
>> Mon May 9 22:24:09 2011 Processing changed file 2009/2009_08_08
>> Mon May 9 22:24:09 2011 Making directory path
>> /media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009
>> Mon May 9 22:24:09 2011 Processing changed file
>> 2009/2009_08_08/2009_08_08 - Bruno
>> Mon May 9 22:24:09 2011 Making directory path
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
>> - Benfica
>> Mon May 9 22:24:09 2011 Processing changed file 2009/2009_08_08 -
>> Benfica/2009_08_08 - Bruno/P1030107.JPG
>> Mon May 9 22:24:09 2011 Making directory path
>>
>/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
>> - Benfica/2009_08_08 - Bruno
>> Mon May 9 22:24:09 2011 Regular copying ('2009', '2009_08_08 -
>> Benfica', '2009_08_08 - Bruno', 'P1030107.JPG') to
>> /media/Elements/rdiff-backup/fotos/2009/2009_08_08 -
>> Benfica/2009_08_08 - Bruno/rdiff-backup.tmp.2
>> Mon May 9 22:24:09 2011 Writing file object to
>> /media/Elements/rdiff-backup/fotos/2009/2009_08_08 -
>> Benfica/2009_08_08 - Bruno/rdiff-backup.tmp.2
>> Mon May 9 22:24:09 2011 Exception '[Errno 75] Value too large for
>> defined data type' raised of class '<type 'exceptions.IOError'>':
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line
>32,
>> in check_common_error
>> try: return function(*args)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>105, in copy
>> if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>133,
>> in copy_reg_file
>> return rpout.write_from_fileobj(rpin.open("rb"), compress =
>compress)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>> 1195, in write_from_fileobj
>> copyfileobj(fp, outfp)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>62,
>> in copyfileobj
>> inbuf = inputfp.read(blocksize)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>1415, in read
>> def read(self, length = -1): return self.file.read(length)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47,
>in read
>> buf = self.fileobj.read(length)
>>
>> Mon May 9 22:24:09 2011 Exception '[Errno 75] Value too large for
>> defined data type' raised of class '<type 'exceptions.IOError'>':
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>304,
>> in error_check_Main
>> try: Main(arglist)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>324, in Main
>> take_action(rps)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>280,
>> in take_action
>> elif action == "backup": Backup(rps[0], rps[1])
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>346, in Backup
>> backup.Mirror(rpin, rpout)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>38, in Mirror
>> DestS.patch(dest_rpath, source_diffiter)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>232, in patch
>> ITR(diff.index, diff)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rorpiter.py", line
>> 281, in __call__
>> last_branch.fast_process(*args)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>> 529, in fast_process
>> if self.patch_to_temp(mirror_rp, diff_rorp, tf):
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>> 553, in patch_to_temp
>> result = self.patch_snapshot_to_temp(diff_rorp, new)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>> 582, in patch_snapshot_to_temp
>> (diff_rorp, new))
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line
>32,
>> in check_common_error
>> try: return function(*args)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>105, in copy
>> if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>133,
>> in copy_reg_file
>> return rpout.write_from_fileobj(rpin.open("rb"), compress =
>compress)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>> 1195, in write_from_fileobj
>> copyfileobj(fp, outfp)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>62,
>> in copyfileobj
>> inbuf = inputfp.read(blocksize)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>1415, in read
>> def read(self, length = -1): return self.file.read(length)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47,
>in read
>> buf = self.fileobj.read(length)
>>
>> Traceback (most recent call last):
>> File "/usr/bin/rdiff-backup", line 30, in<module>
>> rdiff_backup.Main.error_check_Main(sys.argv[1:])
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>304,
>> in error_check_Main
>> try: Main(arglist)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>324, in Main
>> take_action(rps)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>280,
>> in take_action
>> elif action == "backup": Backup(rps[0], rps[1])
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line
>346, in Backup
>> backup.Mirror(rpin, rpout)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>38, in Mirror
>> DestS.patch(dest_rpath, source_diffiter)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>232, in patch
>> ITR(diff.index, diff)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rorpiter.py", line
>> 281, in __call__
>> last_branch.fast_process(*args)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>> 529, in fast_process
>> if self.patch_to_temp(mirror_rp, diff_rorp, tf):
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>> 553, in patch_to_temp
>> result = self.patch_snapshot_to_temp(diff_rorp, new)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
>> 582, in patch_snapshot_to_temp
>> (diff_rorp, new))
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line
>32,
>> in check_common_error
>> try: return function(*args)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>105, in copy
>> if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>133,
>> in copy_reg_file
>> return rpout.write_from_fileobj(rpin.open("rb"), compress =
>compress)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>> 1195, in write_from_fileobj
>> copyfileobj(fp, outfp)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>62,
>> in copyfileobj
>> inbuf = inputfp.read(blocksize)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
>1415, in read
>> def read(self, length = -1): return self.file.read(length)
>> File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47,
>in read
>> buf = self.fileobj.read(length)
>> IOError: [Errno 75] Value too large for defined data type
>> Search through the rdiff-backup-users Archives but couldn't find
>> any cue to solve the problem.
>>
>> Search the net for similar information and it seems to be related
>with
>> python version before 2.2 and presently I'm using 2.6.5.
>> Follow some version information.
>>
>> <<<
>> $ python --version
>> Python 2.6.5
>> $ rsync --version
>> rsync version 3.0.7 protocol version 30
>> $ dpkg -l | grep rsync
>> ii librsync1 0.9.7-7
>> rsync remote-delta algorithm library
>> ii rsync 3.0.7-1ubuntu1.1
>> fast remote file copy program (like
>rcp)
>> Thank you for your time.
>>
>
>_______________________________________________
>rdiff-backup-users mailing list at address@hidden
>https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
>Wiki URL:
>http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
--
D. Kriesel / dkriesel.com