Hcf middleware

Some changes based in feedback:

  *  Remove idle_spider method
  * Modify default slot assignation function.
  * Send new links to HCF as soon as they are extracted.