start | find | index | login or register | edit
comment-2008-12-23-5
by Kragen Javier Sitaker, 5580 days ago
6 to 10 seconds for queries on a 27-segment index is about what I'd expect, although of course it's frustratingly slow. I've just changed the default chunksize from 200k to 50k, and also changed indexmail.py to build the skipfiles automatically, which should afford noticeably better performance.

If you run merge.py, it will suggest merging all or most of those segments into a single new segment, then deleting the old segments, which will give you much better performance for most queries.

If you wanted to optimize for answering queries out of filesystem cache instead of from disk, you could use a much smaller chunksize, like 1k or 4k. The reason for making the chunksize largish is to avoid spending all of our time doing disk seeks.
powered by vanilla
echo earlZstrainYat|tr ZY @.
earl.strain.at • esa3 • online for 8446 days • c'est un vanilla site