GitHub repository: keshavashiya/awesome-crawler
Description: A collection of awesome web crawler,spider in different languages