[Bug-gnupod] Performance of gnupod on large data sets

[H. Langos]

On Fri, Jun 12, 2009 at 09:51:18PM +0200, Richard van den Berg wrote:
> > To get some numbers on the performance you could do me a favor and add a 
> > single file to the rather full ipod while profiling the perl process.
> >   
> 
> The results are at:
> With 11600 files http://richard.vdberg.org/gnupod/dprof/run1
> With 30415 files http://richard.vdberg.org/gnupod/dprof/run3
> 
> > After the first run please move the tmon.out file aside and run the same 
> > perl -d:DProf /path/to/gnupod_addsong.pl /path/to/file.mp3
> > line once more. (This time gnupod_addsong should abort before writing the
> > file to your ipod because of the duplicate detection.)
> >   
> The results are at:
> With 11600 files http://richard.vdberg.org/gnupod/dprof/run2
> With 30415 files http://richard.vdberg.org/gnupod/dprof/run4
> 
> I did another run with the --artwork switch at
> http://richard.vdberg.org/gnupod/dprof/run5

I took a glance at the stats and I didn't know that artwork does slow down
the process that much.

About xescaped.. I'll add a simple check at the start (after taking care of
the first couple of XML entities) that will return the string if there are 
no characters outside the plain ascii range 0x20-0x7F.. thus skipping any of
the later regex matches and conversions that only apply to utf8 stuff.


cheers
-henrik