Spaces:

upstage
/

open-ko-llm-leaderboard

Restarting on CPU Upgrade

How many shots are used for the evaluation?

#29

by zhiminy - opened Dec 10, 2023

Dec 10, 2023

upstage org Dec 13, 2023

@zhiminy Hello,
ko_commongen_v2 : 2-shot
arc_challenge : 25-shot
hellaswag : 10-shot
MMLU : 5-shot
truthfulQA : 0-shot

it is same configuration as open_llm_leaderboard

choco9966 changed discussion status to closed Dec 13, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment