Re: [Fle3-dev] Import performance

[Janne Pietarila]

On Fri, Jun 14, 2002 at 11:16:34AM +0300, Tarmo Toikkanen wrote:
> Importing data to a new Fle3 is done one object at a time. And creating 
> each note takes time, as we currently create over a dozen DTML objects 
> for each Note object.
> 
> I agree that this is much too slow, but I'm not sure there's much we 
> can do about it, except perhaps restructure the entire knowledge 
> building so that each note doesn't need its own dtml files. This would 
> definitely be a change for the better, but it might prove difficult...
> 
> I tried this spike once at the beginning of the year, and ran into 
> problems... If you replace the dtml files with single copies up in the 
> acquisition tree, everything works as long as you have different names 
> for all dtml files in the tree (notes, contexts, courses). This means 
> that index_html cannot be handled like this. And if we use a python 
> method as a mask, we run into weird problems with dtml files calling 
> other dtml files. When the chain gets longer than 2 or 3 calls, the 
> context object gets dropped in certain cases and things break down.
> 
> But apparently we should try to do this again. Of course, if anyone has 
> any suggestions...

I suggest we fix that at the same time when we port Fle3 to Zope3. 
Everything will be diffrent then, Zope page templates instead of DTML and 
hopefully some stuff from CMF that will make the task easier...

-- 
Janne Pietarila
The Fle3 Team
http://fle3.uiah.fi