scrapy-distributed (pypi): A series distributed components for Scrapy framework
Keywords: crawler|crawling|distributed-spider|kafka|python|rabbitmq|rabbitmq-pipeline|redis|redisbloom|scraping|scrapy|spider