GitHub repository: 24/WebHubBot
Primary language: Python
Description: Python + Scrapy + MongoDB 5 million data per day !!!!!!!    https://github.com/xiyouMark/WebBot