Massive scalable REST based asynchronous web crawler