Treat the binary case differently from the case when n_classes > 2.