continue working on directory crawling tests for indexer