Spaces:
Running
on
CPU Upgrade
[Important]: Announcement
Dear S23DR challenge participants,
We would like to thank user rozumden for reporting a bug in our implementation of the WED metric used in the challenge (see the relevant PR here).
After careful examination, we confirmed that this is the case and that the metric is indeed incorrect. Additionally, the default hyperparameter cv=1 is better suited for samples measured in meters (when we transformed our data to cm we neglected to scale cv accordingly).
After considering various solutions, we have decided to take the following actions:
- Update the Competition Metric: The new, corrected version of the metric (with updated cv) is available here.
- Increase Daily Submission Limit: To compensate for potential leaderboard changes, we are increasing the daily submission limit to 10.
- Extend the Deadline: We are extending the submission deadline to June 10.
- Re-run All Submissions: We will re-run all existing submissions with the corrected metric. Therefore, you do not need to resubmit your previous best solutions, though you are welcome to submit any improvements.
You should see these changes (with the exception of [4]) reflected in the space now. We will rerun all submissions in the coming days. We apologize for these last-minute changes but believe this is the best decision given the circumstances.
We want to deeply thank everyone who is participating and engaging in this competition, and are very excited to see how all your solutions stack up with the corrected metric (and meet as many of you as we can at CVPR).
Please don’t hesitate to reach out to us here or via email at s23dr@googlegroups.com with any questions, comments, or suggestions.
With sincere apologies and wishing you best of luck,
The S23DR Organizing Team
Dear S23DR challenge participants,
We’d like to start by again thanking everyone for participating in and engaging with the competition. We are following up about our previous announcement. We have fixed the bug and recomputed the leaderboard. The new results are online now on the competition page under the Public Leaderboard tab.
We have also taken the opportunity presented by the bug to make a final update to the metric to better incentivize genuine solutions over the zero/empty solution (penalizing vertex insertion more heavily than deletion). Please make sure to update to the latest hoho tools (version 0.4).
We again apologize for these last minute changes and sincerely thank everyone for their participation and engagement. We can’t wait to see your solutions!
A few other logistical notes:
- As mentioned in the previous email, the final submission deadline is June 10th
- Team Merging in the HuggingFace Competition platform currently has to be done manually by the organizers. Please state your intent to merge in the [Team Merging] thread in the discussion tab of the competition space - you may not privately share information about your solution between teams without merging. All merges must happen before June 4th, or on June 4th at last.
The writeup deadline is June 13th. We strongly encourage all participants to submit a write up and begin working on it prior to the submission date. Even if you are not close to the top of the leaderboard we have additional discretionary prize money as well as allocated short talks which we can use to reward interesting solutions or insightful analysis even for non-winners.
Again thank you for your participation and understanding.
Best of luck!
The S23DR Organizing Team