Text Generation
Transformers
PyTorch
English
llama
Eval Results
text-generation-inference
Inference Endpoints
pankajmathur leaderboard-pr-bot commited on
Commit
e63a535
1 Parent(s): d854f62

Adding Evaluation Results (#3)

Browse files

- Adding Evaluation Results (3975e2cd24391f70a20f63790dff793dfbfc0177)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -196,4 +196,17 @@ Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams,
196
  Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom},
197
  year={2023}
198
  }
199
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
196
  Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom},
197
  year={2023}
198
  }
199
+ ```
200
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
201
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_psmathur__model_007_13b_v2)
202
+
203
+ | Metric | Value |
204
+ |-----------------------|---------------------------|
205
+ | Avg. | 53.78 |
206
+ | ARC (25-shot) | 61.95 |
207
+ | HellaSwag (10-shot) | 82.48 |
208
+ | MMLU (5-shot) | 57.32 |
209
+ | TruthfulQA (0-shot) | 53.5 |
210
+ | Winogrande (5-shot) | 75.85 |
211
+ | GSM8K (5-shot) | 1.36 |
212
+ | DROP (3-shot) | 43.97 |