leaderboard-pr-bot commited on
Commit
2a8bec5
1 Parent(s): 6772940

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -338,4 +338,17 @@ I am purposingly leaving this license ambiguous (other than the fact you must co
338
 
339
  Your best bet is probably to avoid using this commercially due to the OpenAI API usage.
340
 
341
- Either way, by using this model, you agree to completely indemnify me.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
338
 
339
  Your best bet is probably to avoid using this commercially due to the OpenAI API usage.
340
 
341
+ Either way, by using this model, you agree to completely indemnify me.
342
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
343
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_jondurbin__airoboros-l2-7b-gpt4-m2.0)
344
+
345
+ | Metric | Value |
346
+ |-----------------------|---------------------------|
347
+ | Avg. | 44.6 |
348
+ | ARC (25-shot) | 50.51 |
349
+ | HellaSwag (10-shot) | 76.87 |
350
+ | MMLU (5-shot) | 45.35 |
351
+ | TruthfulQA (0-shot) | 41.34 |
352
+ | Winogrande (5-shot) | 69.53 |
353
+ | GSM8K (5-shot) | 4.09 |
354
+ | DROP (3-shot) | 24.48 |