ZF-90: memory segmen storage provider

Issue Type: Improvement Created: 2006-06-21T10:47:54.000+0000 Last Updated: 2009-11-07T08:46:08.000+0000 Status: Resolved Fix version(s): - 0.8.0 (21/Feb/07)

Reporter: Alexander Veremyev (alexander) Assignee: Alexander Veremyev (alexander) Tags: - Zend_Search_Lucene

Related issues: - ZF-87



Zend_Search_Lucene_Storage_Directory_RAM and Zend_Search_Lucene_Storage_File_RAM classes should be added to store segment in memory. It should improve indexing performance.


Posted by Alexander Veremyev (alexander) on 2006-06-21T10:50:46.000+0000

In-memory segment creation is not significant without segment mergin functionality

Posted by Alexander Veremyev (alexander) on 2006-10-20T11:11:09.000+0000

No, it's Zend_Search issue, which doesn't depends from Zend_Memory.

Zend_Memory goal is to use filesystem (or other backend) as a temporary storage for data, when we don't have enough memory.

memory segmen storage provider is a 'virtual filesystem' in RAM. Goal is to speed up document indexing, which performs a lot of small read/write operations.

Posted by Bill Karwin (bkarwin) on 2006-11-13T15:17:38.000+0000

Changing fix version to 0.6.0.

Posted by Alexander Veremyev (alexander) on 2007-01-24T19:50:31.000+0000


Zend_Search_Lucene uses MaxBufferedDocs option to accumulate documents in memory.

Posted by Chris Mattmann (chrismattmann) on 2009-04-24T19:53:44.000+0000


In the case where there is a separate Lucene index, built from e.g., Java Lucene, then wouldn't a Zend_Search_Lucene RAMDirectory that loads that separately created index into memory and then supports querying of it as persisted in RAM significantly speed up the performance of ZSL?

I can see how MaxBufferedDocs affects indexing performance, but how does it affect search performance?

Thanks, Chris

Posted by Alexander Veremyev (alexander) on 2009-11-06T03:26:18.000+0000

Chris, I've just got your comment. MaxBufferedDocs doesn't affect search performance. But Java Lucene RAMDirectory implementation also used only during indexing. OS supported RAM disk or OS level file system caching may be used to increase search performance.

Posted by Chris Mattmann (chrismattmann) on 2009-11-07T08:46:03.000+0000

Thanks for your comment, Alexander. Is an OS supported RAM disk or OS level file system caching something that we could implement in Zend_Search_Lucene? I'm willing to help, just point me in the right direction...

Have you found an issue?

See the Overview section for more details.


© 2006-2018 by Zend, a Rogue Wave Company. Made with by awesome contributors.

This website is built using zend-expressive and it runs on PHP 7.