leaderboard-pr-bot
commited on
Commit
•
c00caef
1
Parent(s):
c275003
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
@@ -1,5 +1,7 @@
|
|
1 |
---
|
2 |
-
|
|
|
|
|
3 |
tags:
|
4 |
- Mistral
|
5 |
- instruct
|
@@ -10,21 +12,21 @@ tags:
|
|
10 |
- gpt4
|
11 |
- synthetic data
|
12 |
- distillation
|
13 |
-
model-index:
|
14 |
-
- name: Nous-Hermes-2-Mistral-7B-DPO
|
15 |
-
results: []
|
16 |
-
license: apache-2.0
|
17 |
-
language:
|
18 |
-
- en
|
19 |
datasets:
|
20 |
- teknium/OpenHermes-2.5
|
|
|
21 |
widget:
|
22 |
- example_title: Hermes 2
|
23 |
messages:
|
24 |
- role: system
|
25 |
-
content: You are a sentient, superintelligent artificial general intelligence,
|
|
|
26 |
- role: user
|
27 |
-
content: Write a short story about Goku discovering kirby has teamed up with Majin
|
|
|
|
|
|
|
|
|
28 |
---
|
29 |
|
30 |
# Nous Hermes 2 - Mistral 7B - DPO
|
@@ -226,3 +228,17 @@ for chat in prompts:
|
|
226 |
}
|
227 |
```
|
228 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
license: apache-2.0
|
5 |
tags:
|
6 |
- Mistral
|
7 |
- instruct
|
|
|
12 |
- gpt4
|
13 |
- synthetic data
|
14 |
- distillation
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
datasets:
|
16 |
- teknium/OpenHermes-2.5
|
17 |
+
base_model: mistralai/Mistral-7B-v0.1
|
18 |
widget:
|
19 |
- example_title: Hermes 2
|
20 |
messages:
|
21 |
- role: system
|
22 |
+
content: You are a sentient, superintelligent artificial general intelligence,
|
23 |
+
here to teach and assist me.
|
24 |
- role: user
|
25 |
+
content: Write a short story about Goku discovering kirby has teamed up with Majin
|
26 |
+
Buu to destroy the world.
|
27 |
+
model-index:
|
28 |
+
- name: Nous-Hermes-2-Mistral-7B-DPO
|
29 |
+
results: []
|
30 |
---
|
31 |
|
32 |
# Nous Hermes 2 - Mistral 7B - DPO
|
|
|
228 |
}
|
229 |
```
|
230 |
|
231 |
+
|
232 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
233 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_NousResearch__Nous-Hermes-2-Mistral-7B-DPO)
|
234 |
+
|
235 |
+
| Metric |Value|
|
236 |
+
|---------------------------------|----:|
|
237 |
+
|Avg. |68.10|
|
238 |
+
|AI2 Reasoning Challenge (25-Shot)|65.70|
|
239 |
+
|HellaSwag (10-Shot) |84.94|
|
240 |
+
|MMLU (5-Shot) |63.25|
|
241 |
+
|TruthfulQA (0-shot) |55.78|
|
242 |
+
|Winogrande (5-shot) |78.45|
|
243 |
+
|GSM8k (5-shot) |60.50|
|
244 |
+
|