Force urls received from AMQP to be recrawled so custom http headers can...

... be used to make the request for that url.