MMLU is 25?????
#3
by
sleepyjoecheated
- opened
What?
Context: questions in MMLU have four choices each, so MMLU=25 means the model is not performing any better than random chance.
What?
Context: questions in MMLU have four choices each, so MMLU=25 means the model is not performing any better than random chance.