怎么测试mmlu数据集精度呢？

#48

by StriveForC - opened Mar 21

Mar 21

我在本地测试mmlu的精度是50.6，没办法复现61.4

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org Mar 26

你是使用base模型吗

Mar 27

是的，请问有提供精度测试的code吗

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org Mar 31

目前没有

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment