leaderboard-pr-bot commited on
Commit
5d09c6b
1 Parent(s): d2f3e5e

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -131,4 +131,17 @@ To cite this model:
131
  month = Augest
132
  }
133
  ```
134
- [![Model architecture](https://img.shields.io/badge/Model%20Arch-Transformer%20Decoder-green)](#model-architecture)|[![Model size](https://img.shields.io/badge/Params-20B-green)](#model-architecture)|[![Language](https://img.shields.io/badge/Language-en--US-lightgrey#model-badge)](#datasets)|![AUR license](https://img.shields.io/badge/license-Apache%202-blue)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
131
  month = Augest
132
  }
133
  ```
134
+ [![Model architecture](https://img.shields.io/badge/Model%20Arch-Transformer%20Decoder-green)](#model-architecture)|[![Model size](https://img.shields.io/badge/Params-20B-green)](#model-architecture)|[![Language](https://img.shields.io/badge/Language-en--US-lightgrey#model-badge)](#datasets)|![AUR license](https://img.shields.io/badge/license-Apache%202-blue)
135
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
136
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Writer__InstructPalmyra-20b)
137
+
138
+ | Metric | Value |
139
+ |-----------------------|---------------------------|
140
+ | Avg. | 37.98 |
141
+ | ARC (25-shot) | 47.1 |
142
+ | HellaSwag (10-shot) | 73.0 |
143
+ | MMLU (5-shot) | 28.26 |
144
+ | TruthfulQA (0-shot) | 41.81 |
145
+ | Winogrande (5-shot) | 64.72 |
146
+ | GSM8K (5-shot) | 2.58 |
147
+ | DROP (3-shot) | 8.36 |