Actually anything that goes into a `LabelBinarizer` is accepted. The question is whether we should advertise that (probably not without a test for all cases).