GitHub repository: scrapy-plugins/scrapy-hcf
Primary language: Python
Created: 2016-07-18T13:24:39Z
Description: Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLs