indexing: progress on tuning indexing algorithm and better profiling
indexing: minor cleanup
indexing: many minor changes
indexing: minor optimizations
indexing: added code to track a couple more stats
indexing: adding comments
indexing: making constants for some strings used in multiple places
indexing: cleaning up and adding more comments
indexing: removed redundant constructor
indexing: more cleanup
indexing: more cleanup and comments
indexing: more optimizations of the process of
getting index queries from terms.
indexing: added a new visitor class for traversing terms at run time for indexing purposes.
indexing: more cleanup and adding comments
indexing: more cleanup and adding more comments
indexing: added some TODO