GitHub repository: playandbuild/scrapy-history-middleware
Primary language: Python
Description: Scrapy middleware for building historical S3 cache for crawled web resources.