Handle the case that the currently set oneof field is unset