How come it doesn't get perfect scores?
#3
by
CamiloMM
- opened
If I understood this correctly, the model should get top scores in the benchmarks, maybe even perfect ones. Right?
Yes, you are right. I could make it have perfect scores.
But, if do, the extremely high scores compared to other models will seem strange. But by showing that it is possible to control the scores themselves, it would be more useful.
I made these high scores intentionally to seem to have top scores possible and realistic.
So you actually targeted those exact specific scores? Or you mean you under-trained and picked a checkpoint where roughly they looked high but not suspiciously high?