First commit multithreaded crawler
Merge github.com:PrateekRajan/MultiThreadedCrawler