updates to indexing framework, bug fixes