Re: [rdiff-backup-users] Intermittent connection failures

[Phil Austin]

On 07/04/2011 06:48 AM, Maarten Bezemer wrote:
> Hi,
>
> Another way to find out what's going on, could be to add -v to the ssh
> command (remote schema).

I had a similar problem, and kluged my way through using a
python script to write a rdiff-backup shell script that added
top-level directories
one at a time.  By check pointing in this way I avoided having to
start over each time I lost the connection.  Once I got the full
directory tree backed up the incrementals were  small enough
to avoid whatever problem was causing the drops.

Specifically, the script below writes a file called write_backup.sh
that looks like this:

#!/bin/bash -v

echo '+++climate_data/gpcp+++'
/home/phil/usr64/bin/rdiff-backup   --include climate_data/gpcp 
--exclude '**'  --remote-schema 'ssh -C %s 
/home/phil/usr64/bin/rdiff-backup  --server' -v 8 climate_data 
backup_phil::/media/green1/climate_data

echo '+++climate_data/agcm3+++'
/home/phil/usr64/bin/rdiff-backup   --include climate_data/gpcp 
--include climate_data/agcm3   --exclude '**'  --remote-schema 'ssh -C 
%s  /home/phil/usr64/bin/rdiff-backup  --server' -v 8 climate_data 
backup_phil::/media/green1/climate_data

echo '+++climate_data/modis+++'
/home/phil/usr64/bin/rdiff-backup   --include climate_data/gpcp 
--include climate_data/agcm3  --include climate_data/modis   --exclude 
'**'  --remote-schema 'ssh -C %s  /home/phil/usr64/bin/rdiff-backup 
--server' -v 8 climate_data backup_phil::/media/green1/climate_data

etc.

import textwrap, glob
import os.path
the_template=\
   """
       echo '+++%s+++'
       /home/phil/usr64/bin/rdiff-backup  %s --exclude '**' 
--remote-schema 'ssh -C %%s  /home/phil/usr64/bin/rdiff-backup 
--server' -v 8 climate_data backup_phil::/media/green1/climate_data
   """

the_template=textwrap.dedent(the_template)

include_string=' '
outfile=open('write_backup.sh','w')
outfile.write('#!/bin/bash -v\n')
allfiles=glob.glob('climate_data/*')
for in_file in allfiles:
    if os.path.isdir(in_file):
        include_string = include_string + '--include %s  ' % in_file
        outfile.write(the_template % (in_file,include_string))
outfile.close()