darkrho/scrapy-redis — pull request #15 by nside (2013-12-02 18:37:50+00:00)
Title: avoid waiting for the spider to be idle before popping the redis queue

This will increase the throughput of your spiders significantly.