ZeroXClem commited on
Commit
cd244d8
1 Parent(s): 6849553

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (6b8043413547bf69d45be3b0cd916d99e210d904)

Files changed (1) hide show
  1. README.md +112 -4
README.md CHANGED
@@ -1,5 +1,8 @@
1
  ---
 
 
2
  license: apache-2.0
 
3
  tags:
4
  - merge
5
  - mergekit
@@ -15,9 +18,101 @@ base_model:
15
  - allknowingroger/HomerSlerp1-7B
16
  - bunnycore/Qwen2.5-7B-Instruct-Fusion
17
  - bunnycore/Qandora-2.5-7B-Creative
18
- language:
19
- - en
20
- library_name: transformers
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  ---
22
 
23
  # ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
@@ -179,4 +274,17 @@ This model is open-sourced under the **Apache-2.0 License**.
179
  - `allknowingroger/HomerSlerp1-7B`
180
  - `newsbang/Homer-v0.5-Qwen2.5-7B`
181
 
182
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  license: apache-2.0
5
+ library_name: transformers
6
  tags:
7
  - merge
8
  - mergekit
 
18
  - allknowingroger/HomerSlerp1-7B
19
  - bunnycore/Qwen2.5-7B-Instruct-Fusion
20
  - bunnycore/Qandora-2.5-7B-Creative
21
+ model-index:
22
+ - name: Qwen2.5-7B-HomerCreative-Mix
23
+ results:
24
+ - task:
25
+ type: text-generation
26
+ name: Text Generation
27
+ dataset:
28
+ name: IFEval (0-Shot)
29
+ type: HuggingFaceH4/ifeval
30
+ args:
31
+ num_few_shot: 0
32
+ metrics:
33
+ - type: inst_level_strict_acc and prompt_level_strict_acc
34
+ value: 78.35
35
+ name: strict accuracy
36
+ source:
37
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
38
+ name: Open LLM Leaderboard
39
+ - task:
40
+ type: text-generation
41
+ name: Text Generation
42
+ dataset:
43
+ name: BBH (3-Shot)
44
+ type: BBH
45
+ args:
46
+ num_few_shot: 3
47
+ metrics:
48
+ - type: acc_norm
49
+ value: 36.77
50
+ name: normalized accuracy
51
+ source:
52
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
53
+ name: Open LLM Leaderboard
54
+ - task:
55
+ type: text-generation
56
+ name: Text Generation
57
+ dataset:
58
+ name: MATH Lvl 5 (4-Shot)
59
+ type: hendrycks/competition_math
60
+ args:
61
+ num_few_shot: 4
62
+ metrics:
63
+ - type: exact_match
64
+ value: 32.33
65
+ name: exact match
66
+ source:
67
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
68
+ name: Open LLM Leaderboard
69
+ - task:
70
+ type: text-generation
71
+ name: Text Generation
72
+ dataset:
73
+ name: GPQA (0-shot)
74
+ type: Idavidrein/gpqa
75
+ args:
76
+ num_few_shot: 0
77
+ metrics:
78
+ - type: acc_norm
79
+ value: 6.6
80
+ name: acc_norm
81
+ source:
82
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
83
+ name: Open LLM Leaderboard
84
+ - task:
85
+ type: text-generation
86
+ name: Text Generation
87
+ dataset:
88
+ name: MuSR (0-shot)
89
+ type: TAUR-Lab/MuSR
90
+ args:
91
+ num_few_shot: 0
92
+ metrics:
93
+ - type: acc_norm
94
+ value: 13.77
95
+ name: acc_norm
96
+ source:
97
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
98
+ name: Open LLM Leaderboard
99
+ - task:
100
+ type: text-generation
101
+ name: Text Generation
102
+ dataset:
103
+ name: MMLU-PRO (5-shot)
104
+ type: TIGER-Lab/MMLU-Pro
105
+ config: main
106
+ split: test
107
+ args:
108
+ num_few_shot: 5
109
+ metrics:
110
+ - type: acc
111
+ value: 38.3
112
+ name: accuracy
113
+ source:
114
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
115
+ name: Open LLM Leaderboard
116
  ---
117
 
118
  # ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
 
274
  - `allknowingroger/HomerSlerp1-7B`
275
  - `newsbang/Homer-v0.5-Qwen2.5-7B`
276
 
277
+ ---
278
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
279
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ZeroXClem__Qwen2.5-7B-HomerCreative-Mix)
280
+
281
+ | Metric |Value|
282
+ |-------------------|----:|
283
+ |Avg. |34.35|
284
+ |IFEval (0-Shot) |78.35|
285
+ |BBH (3-Shot) |36.77|
286
+ |MATH Lvl 5 (4-Shot)|32.33|
287
+ |GPQA (0-shot) | 6.60|
288
+ |MuSR (0-shot) |13.77|
289
+ |MMLU-PRO (5-shot) |38.30|
290
+