Commit
c4465a6
1 Parent(s): 730fe06

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (a1b189e3276a8a2f4aa7e6b4ff6885161819b25c)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +21 -8
README.md CHANGED
@@ -1,21 +1,21 @@
1
  ---
2
  language:
3
- - en
4
  license: apache-2.0
5
  library_name: peft
6
  tags:
7
- - mistral
8
- - generated_from_trainer
9
- - Transformers
10
- - text-generation-inference
11
  datasets:
12
- - robinsmits/ChatAlpaca-20K
13
  inference: false
14
  base_model: mistralai/Mistral-7B-Instruct-v0.2
 
15
  model-index:
16
  - name: Mistral-Instruct-7B-v0.2-ChatAlpaca
17
  results: []
18
- pipeline_tag: text-generation
19
  ---
20
 
21
  # Mistral-Instruct-7B-v0.2-ChatAlpaca
@@ -104,4 +104,17 @@ The following hyperparameters were used during training:
104
  - Transformers 4.36.2
105
  - Pytorch 2.1.2+cu121
106
  - Datasets 2.16.0
107
- - Tokenizers 0.15.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  language:
3
+ - en
4
  license: apache-2.0
5
  library_name: peft
6
  tags:
7
+ - mistral
8
+ - generated_from_trainer
9
+ - Transformers
10
+ - text-generation-inference
11
  datasets:
12
+ - robinsmits/ChatAlpaca-20K
13
  inference: false
14
  base_model: mistralai/Mistral-7B-Instruct-v0.2
15
+ pipeline_tag: text-generation
16
  model-index:
17
  - name: Mistral-Instruct-7B-v0.2-ChatAlpaca
18
  results: []
 
19
  ---
20
 
21
  # Mistral-Instruct-7B-v0.2-ChatAlpaca
 
104
  - Transformers 4.36.2
105
  - Pytorch 2.1.2+cu121
106
  - Datasets 2.16.0
107
+ - Tokenizers 0.15.0
108
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
109
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_robinsmits__Mistral-Instruct-7B-v0.2-ChatAlpaca)
110
+
111
+ | Metric |Value|
112
+ |---------------------------------|----:|
113
+ |Avg. |61.21|
114
+ |AI2 Reasoning Challenge (25-Shot)|56.74|
115
+ |HellaSwag (10-Shot) |80.82|
116
+ |MMLU (5-Shot) |59.10|
117
+ |TruthfulQA (0-shot) |55.86|
118
+ |Winogrande (5-shot) |77.11|
119
+ |GSM8k (5-shot) |37.60|
120
+