Refactoring crawler into DirectorySearch class.