Re: [Duplicity-talk] performance issue

[Greg Hewgill]

On Thu, Jul 31, 2008 at 09:55:58AM -0500, Chris Chatelain wrote:
> to take 70 minutes or so, and suddenly one day it jumped to taking 4 or 5 
> hours. The size of the files has only gone up from 32GB to about 36. 

A while back I noticed a similar issue and wrote a blog post about it:
http://hewgill.com/journal/entries/366-amazon-s3-performance

I didn't investigate much further than what's written there, but the
conclusion is that large files can cause duplicity to slow down a lot,
and it's probably because of librsync behaviour.

Greg Hewgill
http://hewgill.com