Added the multithreaded crawler