Lewdiculous commited on
Commit
19a1a78
1 Parent(s): aa28ea9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -31
README.md CHANGED
@@ -34,37 +34,21 @@ Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
34
  ]
35
  ```
36
 
37
- ## Original model information:
38
-
39
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/U-A4s_BZyJZQTtYrFAVBa.jpeg)
40
-
41
- This model was merged using the SLERP merge method.
42
 
43
- ### Models Merged
44
 
45
- The following models were included in the merge:
46
- * [Nitral-AI/Eris-Beach_Day-7b](https://huggingface.co/Nitral-AI/Eris-Beach_Day-7b)
47
- * [Nitral-AI/Lelanta-lake-7b](https://huggingface.co/Nitral-AI/Lelanta-lake-7b)
48
-
49
- ### Configuration
50
-
51
- The following YAML configuration was used to produce this model:
52
 
53
- ```yaml
54
- slices:
55
- - sources:
56
- - model: Nitral-AI/Lelanta-lake-7b
57
- layer_range: [0, 32]
58
- - model: Nitral-AI/Eris-Beach_Day-7b
59
- layer_range: [0, 32]
60
- merge_method: slerp
61
- base_model: Nitral-AI/Lelanta-lake-7b
62
- parameters:
63
- t:
64
- - filter: self_attn
65
- value: [0, 0.5, 0.3, 0.7, 1]
66
- - filter: mlp
67
- value: [1, 0.5, 0.7, 0.3, 0]
68
- - value: 0.5
69
- dtype: bfloat16
70
- ```
 
34
  ]
35
  ```
36
 
37
+ **Sumbmitted card image:**
 
 
 
 
38
 
39
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/oTFe-bLD1qiOHMeAZMkRr.png)
40
 
41
+ ## Original model information:
 
 
 
 
 
 
42
 
43
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
44
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_vicgalle__RoleBeagle-11B)
45
+
46
+ | Metric |Value|
47
+ |---------------------------------|----:|
48
+ |Avg. |76.06|
49
+ |AI2 Reasoning Challenge (25-Shot)|72.35|
50
+ |HellaSwag (10-Shot) |89.77|
51
+ |MMLU (5-Shot) |66.35|
52
+ |TruthfulQA (0-shot) |77.92|
53
+ |Winogrande (5-shot) |84.06|
54
+ |GSM8k (5-shot) |65.88|