scrapy/slybot — pull request #30 by kalessin (2012-10-18 21:16:23+00:00)
Title: use generators instead of lists in spider, in order to reduce memory

usage when many and big requests are generated