[scrapy] handle phantom cleanup by running close on errors and spider_closed + cleanup dependencies + better logs