clean shutdown without draining entire amqp queue (only consume urls from amqp when browser activity isn't saturated)