Ingest metrics from autoevaluator

by HF staff - opened
Evaluation on the Hub org

For some reason, the leaderboard doesn't display the results from the evaluation service - example here.

Perhaps the issue is that we now report the same metrics (accuracy & F1 score) twice (verified vs self-reported)?

I'm on it!


Oh yes probably because of what you mention.

I've pushed a fix. Let me know if there are any other issues.

Closing because I think we're good now

changed discussion status to closed

Sign up or log in to comment