Remove slow calls to sklearn.metrics.fbeta_score