[rdiff-backup-users] Backup not identifying changed file, even though hash is different

[Scott Jilek]

I have a 1GB Truecrypt file that I am trying to backup, however, 
Rdiff-backup isn't identifying it as a changed file and therefore skips 
it.  When i run the compare, it says "metadata the same, data changed",  
(which I expect) but why isn't rdiff-backup actually backing up the 
file?  I'm using a volume shadow copy on windows, so it shouldn't be a 
locking issue.  Other "normal" files in the same directories are backed 
up just fine so the setup works, just not with this one file.

How does Rdiff identify changes that trigger backup?  I know the file 
times/file size will not change since it's a fixed size 1GB container 
and Truecrypt purposely doesn't update file timestamps, but the hash 
will change as the contents will change.

Is there any way to force Rdiff to use a hash compare for difference 
triggering?  I looked over the manual, and nothing seems to be what I'm 
looking for.  Whatever the default comparison method, it's not catching 
changes to this file [Firefox_encrypted_profiles.tcdsk].

Here's the commands & output from 2 steps I'm running (minus all the 
volumeshadow setup commands):
[backup]
rdiff-backup.exe --backup-mode -v8 --no-acls --no-hard-links 
"X:/Documents and Settings/myUsername/Application Data/Mozilla/Firefox" 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store >> 
rdiffBackup_log.txt 2>&1

[compare]
rdiff-backup.exe --backup-mode -v8 --no-acls --no-hard-links 
--compare-hash "X:/Documents and Settings/myUsername/Application 
Data/Mozilla/Firefox" 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store >> 
rdiffBackup_log.txt 2>&1


******************************************************************************
**** BACKUP STEP OUTPUT  
*****************************************************
******************************************************************************
Rdiff-backup started at Tue 03/22/2011 17:12:14.97 error level 0
Using rdiff-backup version 1.3.3
Hardlinks disabled by default on Windows
Unable to import module xattr.
Extended attributes not supported on filesystem at X:/Documents and 
Settings/myUsername/Application Data/Mozilla/Firefox
POSIX ACLs test skipped. rdiff-backup run with --no-acls option.
Windows ACLs test skipped. rdiff-backup run with --no-acls option.
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         Off
  Extended attributes                          Off
  Windows access control lists                 Off
  Case sensitivity                             Off
  Escape DOS devices                           On
  Escape trailing spaces                       On
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Making directory 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/5-_ 
a.snapshot.gz
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/5-_ 
a.snapshot.gz
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/uni?
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/uni?
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/A
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/a
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/foo
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/foo
Making directory 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/hl
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Hard linking 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2 
to 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Directories on file system at 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0 
are not fsyncable.
Assuming it's unnecessary.
Unable to import module xattr.
Extended attributes not supported on filesystem at 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0
POSIX ACLs test skipped. rdiff-backup run with --no-acls option.
Windows ACLs test skipped. rdiff-backup run with --no-acls option.
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/foo
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0/foo
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0
Removing directory 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/rdiff-backup.tmp.0
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
  Ownership changing                           Off
  Hard linking                                 N/A
  fsync() directories                          Off
  Directory inc permissions                    Off
  High-bit permissions                         On
  Symlink permissions                          Off
  Extended filenames                           On
  Windows reserved filenames                   On
  Access control lists                         Off
  Extended attributes                          Off
  Windows access control lists                 Off
  Case sensitivity                             Off
  Escape DOS devices                           On
  Escape trailing spaces                       On
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Backup: escape_dos_devices = 0
Backup: escape_trailing_spaces = 0
Enabled use_compatible_timestamps
Symbolic links excluded by default on Windows
Writing mirror marker 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/current_mirror.2011-03-22T17-12-16-05-00.data
Starting increment operation X:/Documents and 
Settings/myUsername/Application Data/Mozilla/Firefox to 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store
Writing mirror_metadata diff
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/mirror_metadata.2011-03-22T12-51-45-05-00.diff
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/mirror_metadata.2011-03-22T12-51-45-05-00.snapshot.gz
Deleting 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/current_mirror.2011-03-22T12-51-45-05-00.data
Cleaning up
Touching 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data/error_log.2011-03-22T17-12-16-05-00.data
Rdiff-backup process finished at Tue 03/22/2011 17:12:18.97 error level 0


******************************************************************************
**** COMPARE STEP OUTPUT 
*****************************************************
******************************************************************************
Rdiff-backup started at Tue 03/22/2011 17:11:21.53 error level 0
Using rdiff-backup version 1.3.3
Using mirror root directory 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store
Hardlinks disabled by default on Windows
Unable to import module xattr.
Extended attributes not supported on filesystem at 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data
POSIX ACLs test skipped. rdiff-backup run with --no-acls option.
Windows ACLs test skipped. rdiff-backup run with --no-acls option.
-----------------------------------------------------------------
Detected abilities for 
\\NASserver\myUsername\PC_BACKUP\Rdiff_Backups\encrypted_store/rdiff-backup-data 
(read only) file system:
  Access control lists                         Off
  Extended attributes                          Off
  Windows access control lists                 Off
  Case sensitivity                             Off
  Escape DOS devices                           On
  Escape trailing spaces                       On
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Backup: escape_dos_devices = 0
Backup: escape_trailing_spaces = 0
Enabled use_compatible_timestamps
Symbolic links excluded by default on Windows
Successful compare: .
metadata the same, data changed: Firefox_encrypted_profiles.tcdsk
Successful compare: profiles.ini
Cleaning up
Rdiff-backup process finished at Tue 03/22/2011 17:17:20.53 error level 0