Major refactoring of index/search process to migrate to lucene 4.1.