Create a thread for each directory (probably need some kind of directory queue and a thread pool)