GitHub repository: zanachka/scrapy-distributed
Primary language: Python
Description: AMQP(RabbitMQ), Bloom Filter on Redis (RedisBloom) for Scrapy