clarencen/lshift — Issue #80: Correlation store mismatch query should stream results
Author: clarencen
Created: 2011-11-14 22:41:37+00:00
State: open

#375 introduced the concept of an incremental synchronization between the correlation store and the difference store. During this, the query and transfer APIs were specified such that the results could theoretically be transferred in a streaming fashion, rather than materializing the entire result set. As an improvement, we should avoid buffering the entire result set in the document collector and instead we should stream the results out of the index.