Spaces:
Running
on
CPU Upgrade
[FLAG] dasomysky/unv_test_v0.1.0
Hello!
I am curious about the dasomysky/unv_test_v0.1.0.
When I checked the model in the leaderboard, the truthfulQAis 91.06..!🤔🤔
It is impossible to value at least currently...😶
Also, this model cannot check now..
But, I think we should examine the dasomysky/unv_test_v0.1.0 model.😤
I suspicious about data contamination.🤔
(I think the possible cases are Base model contamination🫥 or Data leakage🫥)
Below, I suggest some ideas:
- @dasomysky // Please share some information about your model 🤗🤗
- Base model
- Using data
- Anything else...
If someone has seen a structure or readme for this model, please share it..🤗🤗
Is there another method to check this model? 🤗🤗
Thanks.
Hello. I checked the result you shared. Actually, the author also contacted our team and replied that the data contamination is suspected.
If @dasomysky reveals the base model and the current model, we will check the data contamination ourselves and delete it from the leaderboard if there is a problem. (If there is no answer by this Sunday, I will delete it.)
Thank you.
I deleted dasomysky/unv_test_v0.1.0 model in ledearboard.
if any problem, please contact to me.
Thanks.