> The problem is that we often clone estimators and fore each cloned estimator we would have to call that `check_scorable` again. I would leave it like that.

I don't understand why: the passthrough scorer will work just as well with the clone as the base estimator... Have I missed something?