GitHub repository: 15310944349/scrapy-redis
Primary language: Python
Description: Redis-based components for scrapy that allows distributed crawling