[Duplicity-talk] backend errors during successful backup - can I ignore?

[henimp]

First, thank you for integrating the acdcli backend. I've used it on a  
couple machines. Amazon Cloud Drive seems to be slow and a little bit  
unreliable compared to other cloud backup providers. I don't know if  
that's due to ACD being consumer oriented or because Amazon's  
systems/networks are not as good.

On one server, I got some errors and warnings in the course of a  
backup operation, but duplicity reported the backup as having  
completed. I'd like to ask if this is something to be concerned about.

There were a few different kinds of errors and warnings (examples  
below), but they all include the text "Attempt 1 failed" so am I to  
understand that this means duplicity will retry such failures and  
everything is OK as long as duplicity reported the normal statistics  
at the end?
(I did check the ACD online file list for some of the failed files and  
they are listed there)

It's also interesting to note that one of the errors indicated that  
Amazon was asking me to stop uploading files so fast - it looks like  
acdcli understands this and paused the duplicity operation? I guess  
the entire package is robust enough to handle that?

Last question, the final error listed in the duplicity log had a  
timestamp that was AFTER the "EndTime" reported by the duplicity  
statistics that were printed BELOW that error message. In fact, the  
acd_cli log file showed some activity AFTER the timestamp of that  
error too! I'm curious what to make of this.

PS - The progress meter type output returned from the backend looks to  
be intended for interactive uses; any way to get rid of that?

Here are examples of the errors I saw:


16-05-30 14:46:30.214 [WARNING] [acd_cli] - Timeout while uploading  
"/tmp/duplicity-6QhuKP-tempdir/duplicity_temp.1/duplicity-full.20160530T143513Z.vol4.difftar.gpg.vol000+200.par2".

Attempt 1 failed. BackendException: Error running 'acd_cli upload  
--force --overwrite  
'/tmp/duplicity-6QhuKP-tempdir/duplicity-full.20160530T143513Z.vol7.difftar.gpg' '/backups3/'': returned 8, with  
output:
[                         ]   0.0% of   25MiB  0/1     0.0B/s        
0s^M[                         ]   1.9% of   25MiB  0/1  166.7KB/s    
02:34m^M[######                   ]  26.5% of   25MiB  0/1    2.3MB/s   
    08s^M[###############          ]  63.5% of   25MiB  0/1     
5.5MB/s      01s^M[#########################] 100.0% of   25MiB  1/1    
 8.8MB/s       0s^M[#########################] 100.0% of   25MiB  1/1  
   8.8MB/s       0s^M[#########################] 100.0% of   25MiB   
1/1    8.8MB/s       0s^M[#########################] 100.0% of   25MiB  
 1/1    8.8MB/s       0s^M[#########################] 100.0% of    
25MiB  1/1    8.8MB/s       0s^M[                         ]   0.0% of   
 25MiB  0/1   -2.1KB/s       0s^M
1 file(s) failed.



16-05-30 14:48:26.154 [ERROR] [acd_cli] - Uploading  
"duplicity-full.20160530T143513Z.vol7.difftar.gpg" failed.  
RequestError: 500, {"message":"Internal failure"}.

Attempt 1 failed. BackendException: Error running 'acd_cli upload  
--force --overwrite  
'/tmp/duplicity-6QhuKP-tempdir/duplicity_temp.3/duplicity-full.20160530T143513Z.vol146.difftar.gpg.par2' '/backups3/'': returned 8, with  
output:
[                         ]   0.0% of   39KiB  0/1     0.0B/s        
0s^M[#########################] 100.0% of   40KiB  1/1   13.5KB/s       
 0s^M[                         ]   0.0% of   39KiB  0/1   -15.9B/s     
   0s^M
1 file(s) failed.



16-05-30 21:27:41.353 [ERROR] [acd_cli] - Uploading  
"duplicity-full.20160530T143513Z.vol1193.difftar.gpg" failed.  
RequestError: 429,  
{"logref":"9db471a1-4933-16e2-b81a-6873b0ad0163","message":"System  
unavailable. Please back off for a while and try again  
later","code":""}.

Attempt 1 failed. BackendException: Error running 'acd_cli upload  
--force --overwrite  
'/tmp/duplicity-6QhuKP-tempdir/duplicity-full.20160530T143513Z.vol1199.difftar.gpg' '/backups3/'': returned 8, with  
output:
[                         ]   0.0% of   25MiB  0/1     0.0B/s        
0s^M[                         ]   0.9% of   25MiB  0/1   76.5KB/s    
05:40m^M[##                       ]   8.4% of   25MiB  0/1  736.0KB/s   
    32s^M[##########               ]  40.7% of   25MiB  0/1     
3.6MB/s      04s^M[###################      ]  77.8% of   25MiB  0/1    
 6.8MB/s      00s^M[                         ]   0.0% of   25MiB  0/1  
   5.8KB/s   01:14h^M
1 file(s) failed.




-------------------------------------------------

ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the 
NSA's hands!
$24.95 ONETIME Lifetime accounts with Privacy Features!  
15GB disk! No bandwidth quotas!
Commercial and Bulk Mail Options!