leaderboard-pr-bot commited on
Commit
ba7f9ff
1 Parent(s): f30709d

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -91,3 +91,17 @@ No formal evaluation is available for this model at this time.
91
 
92
  It is recommend to use this model with the KoboldAI software. All feedback and comments can be directed to TeH_Venom on the KoboldAI discord.
93
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
91
 
92
  It is recommend to use this model with the KoboldAI software. All feedback and comments can be directed to TeH_Venom on the KoboldAI discord.
93
 
94
+
95
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
96
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_TehVenom__PPO_Pygway-V8p4_Dev-6b)
97
+
98
+ | Metric | Value |
99
+ |-----------------------|---------------------------|
100
+ | Avg. | 34.94 |
101
+ | ARC (25-shot) | 40.36 |
102
+ | HellaSwag (10-shot) | 67.15 |
103
+ | MMLU (5-shot) | 29.3 |
104
+ | TruthfulQA (0-shot) | 35.26 |
105
+ | Winogrande (5-shot) | 64.4 |
106
+ | GSM8K (5-shot) | 2.65 |
107
+ | DROP (3-shot) | 5.45 |