Check if there's only one level or all values are NA