Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
incomplete evaluation results
#69
by
yin2024
- opened
Hello, there are some incomplete results, e.g. in the retrieval tab, models ranked around 90 to the end don't even have the average score. And a lot eval fields are not filled.
Does it mean somehow the evaluation for these model is still in progress? the incomplete just b/c the eval is not finished?
Are we able to see full results for all models? And if so, do you have an estimation of how long does it take?
Hi this is because either
a) they were submitted incomplete; anyone can run and fill them out if desired
b) they were too expensive for us to run e.g. the ada v1 models which are also long deprecated by now
Most of these models are not very interesting anyways so I don't think it matters too much