Text Generation
Transformers
Safetensors
English
mistral
llama-2
code
Eval Results
Inference Endpoints
text-generation-inference
uukuguy leaderboard-pr-bot commited on
Commit
9b9a961
1 Parent(s): eb96d71

Adding Evaluation Results (#2)

Browse files

- Adding Evaluation Results (934526b86edf1b5473d804f6778dbc5b2639d5be)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -134,3 +134,17 @@ Mistral 7B is a pretrained base model and therefore does not have any moderation
134
  ## The Mistral AI Team
135
 
136
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
134
  ## The Mistral AI Team
135
 
136
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
137
+
138
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
139
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_uukuguy__speechless-mistral-six-in-one-7b)
140
+
141
+ | Metric | Value |
142
+ |-----------------------|---------------------------|
143
+ | Avg. | 53.38 |
144
+ | ARC (25-shot) | 62.97 |
145
+ | HellaSwag (10-shot) | 84.6 |
146
+ | MMLU (5-shot) | 63.29 |
147
+ | TruthfulQA (0-shot) | 57.77 |
148
+ | Winogrande (5-shot) | 77.51 |
149
+ | GSM8K (5-shot) | 18.42 |
150
+ | DROP (3-shot) | 9.13 |