Fix a bug may crash if x label set number