Files changed (1) hide show
  1. README.md +20 -7
README.md CHANGED
@@ -1,16 +1,16 @@
1
  ---
 
 
 
2
  tags:
3
  - generated_from_trainer
 
 
 
4
  base_model: Locutusque/TinyMistral-248M-v2
5
  model-index:
6
  - name: TinyMistral-v2-Test1/
7
  results: []
8
- datasets:
9
- - JeanKaddour/minipile
10
- - epfl-llm/guidelines
11
- license: apache-2.0
12
- language:
13
- - en
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -149,4 +149,17 @@ The following hyperparameters were used during training:
149
  - Transformers 4.37.0.dev0
150
  - Pytorch 2.0.1+cu117
151
  - Datasets 2.15.0
152
- - Tokenizers 0.15.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
  tags:
6
  - generated_from_trainer
7
+ datasets:
8
+ - JeanKaddour/minipile
9
+ - epfl-llm/guidelines
10
  base_model: Locutusque/TinyMistral-248M-v2
11
  model-index:
12
  - name: TinyMistral-v2-Test1/
13
  results: []
 
 
 
 
 
 
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
149
  - Transformers 4.37.0.dev0
150
  - Pytorch 2.0.1+cu117
151
  - Datasets 2.15.0
152
+ - Tokenizers 0.15.0
153
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
154
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Dans-DiscountModels__TinyMistral-v2-Test1)
155
+
156
+ | Metric |Value|
157
+ |---------------------------------|----:|
158
+ |Avg. |28.42|
159
+ |AI2 Reasoning Challenge (25-Shot)|21.50|
160
+ |HellaSwag (10-Shot) |26.79|
161
+ |MMLU (5-Shot) |23.36|
162
+ |TruthfulQA (0-shot) |50.30|
163
+ |Winogrande (5-shot) |48.54|
164
+ |GSM8k (5-shot) | 0.00|
165
+