start | find | index | login or register | edit | ||
comment-2008-12-23-5
by Kragen Javier Sitaker, 5796 days ago
6 to 10 seconds for queries on a 27-segment index is about what I'd expect, although of course it's frustratingly slow. I've just changed the default chunksize from 200k to 50k, and also changed indexmail.py to build the skipfiles automatically, which should afford noticeably better performance.If you run merge.py, it will suggest merging all or most of those segments into a single new segment, then deleting the old segments, which will give you much better performance for most queries. If you wanted to optimize for answering queries out of filesystem cache instead of from disk, you could use a much smaller chunksize, like 1k or 4k. The reason for making the chunksize largish is to avoid spending all of our time doing disk seeks. |
search 42 active users
backlinks (more) none, yet recent stores (more) recent comments echo earlZstrainYat|tr ZY @. |
|
earl.strain.at • esa3 • online for 8662 days • c'est un vanilla site |