more docs and small change tot he scrapy file in the spider