Don't remove an underline unless there is an underline.