ags/indexer — pull request #1 by ags (2012-11-19 09:18:34+00:00)
Title: Rails Camp

From the not so soberly created work log "shit_achieved":

* direct xml indexing (also a performance gain)

* rough index tag insertion into xml

* renaming of index terms (happens after termification, but before scoring so terms can be combined)

* removing index terms as nil, note this affects score (untested if significantly)

* massive performance boost by experimenting with reduced corpus size - above 30 mins to ~3