Update libraries

Update scrapy version to 0.17 so we can use a better httpcache middleware.
Update every file where scrapy.conf.settings was used as a singleton since the api has changed