I just duplicated the __call__ method without the bit that generate `y_true`, but yeah... it'd be better to have them add it in sklearn.