MetaModelv3 / README.md
gagan3012's picture
Adding Evaluation Results (#2)
61ae4d5
metadata
license: apache-2.0
tags:
  - MetaModelv3
  - merge

MetaModelv3

This model is a hybrid of the following models and is trained using the following configuration:

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 74.39
ARC (25-shot) 71.16
HellaSwag (10-shot) 88.39
MMLU (5-shot) 66.32
TruthfulQA (0-shot) 71.86
Winogrande (5-shot) 83.35
GSM8K (5-shot) 65.28