implement more tests for directory crawling