scrapinghub/scrapylib — pull request #22 by andresp99999 (2013-06-04 18:33:50+00:00)
Title: Hcf middleware

Some changes based in feedback:

* Remove idle_spider method
* Modify default slot assignation function.
* Send new links to HCF as soon as they are extracted.