When I first read _fit_binary, it confuses me that classes was not the set of classes/labels, but "a class name".
My suggestion was to change this to make it clearer for the future.

I would change `classes` to `target_name` (better than `class_name`, since it would be consistent with `classification_report`) and pass only a string.