CodeEngine / README.md
Undi95's picture
Adding Evaluation Results (#2)
24b5e3b
|
raw
history blame
840 Bytes
metadata
license: cc-by-nc-4.0

model: https://huggingface.co/jondurbin/airoboros-l2-13b-2.1 + lora: https://huggingface.co/jondurbin/airoboros-lmoe-13b-2.1/tree/main/adapters/code

For Dampf.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 50.96
ARC (25-shot) 58.36
HellaSwag (10-shot) 82.27
MMLU (5-shot) 54.18
TruthfulQA (0-shot) 45.18
Winogrande (5-shot) 74.59
GSM8K (5-shot) 1.52
DROP (3-shot) 40.59