scrapy/scrapy — pull request #592 by illarion (2014-02-12 15:42:25+00:00)
Title: Implemented thrifty sitemap spider

The idea is to generalize well known approach of using spider_idle signal to make sitemap spider process sitemaps one by one