fixed scrapy version requirement
added traceback
better coded