koha-devel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Koha-devel] Re: [Koha-zebra] zebra config problem (still 0, yes, really


From: Sebastian Hammer
Subject: [Koha-devel] Re: [Koha-zebra] zebra config problem (still 0, yes, really 0 !)
Date: Thu, 09 Feb 2006 13:25:50 -0500
User-agent: Mozilla Thunderbird 1.0.7 (Macintosh/20050923)

Mike Taylor wrote:

Date: Thu, 09 Feb 2006 12:02:11 +0100
From: Paul POULAIN <address@hidden>

This time it seems zebra work for both indexing and search.

Excellent news!

What has to be done :
* benchmarking : it seems the zebraidx update is faster than lightning (400biblios/sec : 10 000biblios in 25seconds), while ZOOM indexing is slow (something like 25biblios/second) More benchmarking could be done.

That is a surprising difference, since as you no doubt know, "ZOOM
indexing" is merely the use of ZOOM to pass the records to Zebra for
indexing.  I flatly refuse to believe that the communication layer is
responsible for a slow-down by a factor of 16, so something else is
going on here.  My best guess is that "zebraidx update" is making use
of caching mechanisms that ZOOM's update requests are not benefiting
from.  There may be a way to have ZOOM request that caching: Adam will
be able to tell us.

I don't particularly refuse to believe the factor 16. Network overheads are very expensive.

I think you're only transfering one record at a time, right? That's bad for network latency in itself, but I dunno if either the client API or the server will let us do more at a time.. it might be worth considering, because adding more records at a time is generally a lot faster (per record) than adding single records.

One thing to try, if you don't already do it, is to use a UNIX domain socket if your server and client run on the same site..
zebrasrv unix:s

Will listen on a socket called 's'... since Unix Domain sockets circumvent the network stuff and work just like pipes, they can be tons faster... I usually use this when using Zebra as an embedded engine. I'm hoping Mike's ZOOM Perl wrapper won't prevent you from using this option of the lower-layer tool.

--Seb

_/|_     ___________________________________________________________________
/o ) \/  Mike Taylor  <address@hidden>  http://www.miketaylor.org.uk
)_v__/\  "Lisp is just glorified C with completely different brackets"
         -- Harvey "Max" Thompson.




_______________________________________________
Koha-zebra mailing list
address@hidden
http://lists.nongnu.org/mailman/listinfo/koha-zebra


--
Sebastian Hammer, Index Data
address@hidden   www.indexdata.com
Ph: (603) 209-6853





reply via email to

[Prev in Thread] Current Thread [Next in Thread]