scrapy-deltafetch (pypi): Scrapy middleware to ignore previously crawled pages
Keywords: hacktoberfest|hacktoberfest2021