Upload results are abnormal

#4
by jiaxiangc - opened

Thanks for your work.
Here are some question for submit.

How to fill in "source"? When I upload the .zip files, the "source" is user upload.
What is the correct json format.
The following are our results in a json file. We upload a zip directory containing 16 dimension json file. But the results are 0.

image.png

How to delete upload history? The results are abnormal....
Best wishes.

Vchitect org

Thank you for your timely feedback. I have deleted the problematic data you submitted and fixed the related issues. Please try again.

I want to see the results in local machine. But the app.py can not run.
Error: fatal: repository 'https://huggingface.co/datasets/Vchitect/vbench_leaderboard_submission/' not found

Vchitect org

I'm sorry, but I'm afraid this code cannot run locally.

Vchitect org

You can try to re-submit it in the space by yourself. If you want to delete the content you submitted, you can send an email to me at the first moment. My email is heyinan@pjlab.org.cn.

I got it. I will submit the results in few weeks.

Vchitect org

Looking forward to your results.

Hi, we see your task info is below:
image.png
But in github, the task info contains "_".
image.png
It is not aligned, so the results are 0?

Vchitect org

This is not a problem, we have replaced it uniformly in submission.

Vchitect org
โ€ข
edited Jun 28

We reviewed the submitted terminal output. The reason for the "0" result was that there was an extra level of folder directory in the compressed package. This issue has been fixed in the submission pipeline now. We apologize for any inconvenience caused. Looking forward to your re-submission.

@ynhe Got it. Thanks for fixing this bugs.

jiaxiangc changed discussion status to closed

Sign up or log in to comment