Re: [Pan-devel] Re: Move to database backend

[K. Haley]

Hi Charles,

Charles Kerr wrote:

> My big concern right now is speed.  Hard Drive speed seems to be crucial
> for keeping the headers in a database -- when I download headers right
> now, disk access is the bottleneck rather than bandwidth.  So an
> experienced DB person's opinion on how to tune the tables would be
> great.
>  
When you add the headers are you using a normal insert or are you 
grouping them with a transaction?  I seem to recall the sqlite wiki 
showing that there is a big speed increase when using transactions.  
Another option woud be to store the downloaded headers in a temp table 
and then copy them over to the main table with one select.  Using a temp 
table would also keep the main table open for the UI.  Although now that 
I think about it, threading during the insert could cause a problem for 
either of these methods.  That's were I kept running into problems when 
thinking about this.

signature.asc
Description: OpenPGP digital signature