Force urls received from AMQP to be recrawled so custom http headers can be used to make the request for that url.
Merge branch 'ari-3943' into qa