Benchmarks
Can you add some benchmarks such as MATH-500 and AIME?
Working on it! :)
Amazing! I can't wait to see the results.
@PSM272 Update: MATH 500 eval is done!
qingy2024/QwQ-14B-v0.2-MATH500-Eval
So my version of QwQ does score a little better :D
Interesting, I was hoping it might beat Skywork's Qwen 7B fine-tune… But, it is still pretty good.
@PSM272 Update: MATH 500 eval is done!
qingy2024/QwQ-14B-v0.2-MATH500-Eval
So my version of QwQ does score a little better :D
I was looking at the incorrect answers, and, for most of them, the LLM went into an “infinite loop” without providing an answer… Maybe the temperature was too high...
@PSM272 Update: MATH 500 eval is done!
qingy2024/QwQ-14B-v0.2-MATH500-Eval
So my version of QwQ does score a little better :D
I was looking at the incorrect answers, and, for most of them, the LLM went into an “infinite loop” without providing an answer (or the LLM reached the max output)… Maybe the temperature was too high...
Additionally, can you share your MATH-500 eval code?