Validation + Submission successful, but not on the leaderboard

#10
by sxjscience - opened

I recently made a submission with name "test-submission11B--2" . It passed the python3 cli.py validate check but still does not appear in the leaderboard.

Output of validation run:

/f1b82ce16d57e1fe22640eef7c1317d0f29da538beed11cabecc20f274a19ce6. Subsequent calls will reuse this data.
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:00<00:00, 925.89it/s]
All submission files validated! ✨ πŸš€ ✨
Now you can make a submission πŸ€—

Output of submission command:

43a6242..e27a491  main -> main
Submission successful! πŸŽ‰ πŸ₯³ πŸŽ‰
Your submission will be evaluated on Sunday 25 September 2022 at 12:00 UTC ⏳

Same here. I also made a submission that should have been evaluated on September 25 .

Same here. Successful validation and submission, noting to be evaluated on September 25 but not to see on the leaderboard yet. Thanks.

@lewtun sorry for pinging again but is the RAFT leaderboard still operating? Seems that several people had the same issue.

@abhishek not sure if I'm pinging the right person. Is RAFT leaderboard currently running? I submitted a version with name "test-submission11B--2" but haven't seen the results.

Ought org

Hi folks, thanks for the pings - taking a look at the logs right now.

Hi everyone, scores are now up - apologies for the inconvenience!

sxjscience changed discussion status to closed

Same problem here. Successful validation and submission, and after checking the labels of the submissions they are within the expected labels, but the results don't appear in the leaderboard.
I repeated the submission two consecutive weeks.

PD: It's working now. Thank you to the organizers :)

Is it possible this problem is happening again? I had a submission that said it would be evaluated yesterday, but isn't showing up on the leaderboard.

edit: wrong post. sorry

Sign up or log in to comment