updated file indexer to allow for indexing of more than a million files