Token refresh failure will error out rather than retry the request.