Added parallel DirectoryProcessor to walk the file tree in multiple threads