Make setXXX not change labels unless the label arg is specified