invana-bot (pypi): A web spider framework that can transform websites into datasets with Crawl, Transform and Index workflow.
Keywords: crawler|elasticsearch|mongodb|parser-configs|python|scrapy