Don't update the summary if we don't need to.