obey request method when scrapy deploy is redirected to a new endpoint