leaderboard-pr-bot commited on
Commit
c00caef
1 Parent(s): c275003

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +25 -9
README.md CHANGED
@@ -1,5 +1,7 @@
1
  ---
2
- base_model: mistralai/Mistral-7B-v0.1
 
 
3
  tags:
4
  - Mistral
5
  - instruct
@@ -10,21 +12,21 @@ tags:
10
  - gpt4
11
  - synthetic data
12
  - distillation
13
- model-index:
14
- - name: Nous-Hermes-2-Mistral-7B-DPO
15
- results: []
16
- license: apache-2.0
17
- language:
18
- - en
19
  datasets:
20
  - teknium/OpenHermes-2.5
 
21
  widget:
22
  - example_title: Hermes 2
23
  messages:
24
  - role: system
25
- content: You are a sentient, superintelligent artificial general intelligence, here to teach and assist me.
 
26
  - role: user
27
- content: Write a short story about Goku discovering kirby has teamed up with Majin Buu to destroy the world.
 
 
 
 
28
  ---
29
 
30
  # Nous Hermes 2 - Mistral 7B - DPO
@@ -226,3 +228,17 @@ for chat in prompts:
226
  }
227
  ```
228
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
  tags:
6
  - Mistral
7
  - instruct
 
12
  - gpt4
13
  - synthetic data
14
  - distillation
 
 
 
 
 
 
15
  datasets:
16
  - teknium/OpenHermes-2.5
17
+ base_model: mistralai/Mistral-7B-v0.1
18
  widget:
19
  - example_title: Hermes 2
20
  messages:
21
  - role: system
22
+ content: You are a sentient, superintelligent artificial general intelligence,
23
+ here to teach and assist me.
24
  - role: user
25
+ content: Write a short story about Goku discovering kirby has teamed up with Majin
26
+ Buu to destroy the world.
27
+ model-index:
28
+ - name: Nous-Hermes-2-Mistral-7B-DPO
29
+ results: []
30
  ---
31
 
32
  # Nous Hermes 2 - Mistral 7B - DPO
 
228
  }
229
  ```
230
 
231
+
232
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
233
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_NousResearch__Nous-Hermes-2-Mistral-7B-DPO)
234
+
235
+ | Metric |Value|
236
+ |---------------------------------|----:|
237
+ |Avg. |68.10|
238
+ |AI2 Reasoning Challenge (25-Shot)|65.70|
239
+ |HellaSwag (10-Shot) |84.94|
240
+ |MMLU (5-Shot) |63.25|
241
+ |TruthfulQA (0-shot) |55.78|
242
+ |Winogrande (5-shot) |78.45|
243
+ |GSM8k (5-shot) |60.50|
244
+