GitHub repository: vishalbelsare/scrapy-crawl-once
Primary language: Python
Description: Scrapy middleware which allows to crawl only new content