Extend dependencies.
Move catalogs index.
Queue processing for the crawler.
Crawlers framework, with CKAN crawler.
Procfile and gitignore.