Inspect auth failures to see if we should actually just retry.