Twisted 11.1.0 (precise) can not deal with generators in DeferredList

Also create a list of the crawlers before iterating them because crawlers are removed from the set once stopped