Validation and submission successful, but not on the leaderboard

by - opened


I made a submission on September 16th and it passed the validate script but still does not appear in the leaderboard.

The output of the validation was:

All submission files validated! ✨ 🚀 ✨
Now you can make a submission 🤗

And the output of the submission:

559359c..47498be main -> main
Submission successful! 🎉 🥳 🎉
Your submission will be evaluated on Sunday 17 September 2023 at 12:00 UTC ⏳

Where did I go wrong?

same here. Is there still an evaluation process running on Sundays?

Ought org

Hi @HLaci apologies about this - I run the evals via a cron job on Github Actions and TIL that they are paused if you intervene after a fixed time period. Your evaluation should now be up, but please let me know if not.

@riegerjonas to check - can you share the name of your dataset / submission? I'm pretty confident it will be evaluated on Sunday, but want to make sure :)

@lewtun the submission is named PETapter and should be part of the 8 October 2023 evaluation

Hi @lewtun thank You that submission is up on the leaderboard. I tried creating another submission named SetFitCentroid that was supposed to be part of the 29 October 2023 evaluation.
It seems it did not appear on the leaderboard. Could you check it please?

My submission "PETapter" from 8 October 2023 is still not on the leaderboard. Any problems with my submission?

Hi @lewtun I'm having the same problem. My submission is called "Miles" and it was submitted successfully to be evaluated Sunday 19 November 2023 at 12:00 UTC. Would you be able to check it out?

Ought org

Hello folks, @abhishek and I are doing some maintenance on the leaderboard backend, so it's currently offline. Hope to have it back up soon. Apologies for the inconvenience.

Sign up or log in to comment