cloudyu leaderboard-pr-bot commited on
Commit
22a15cf
1 Parent(s): 19872ae

Adding Evaluation Results (#16)

Browse files

- Adding Evaluation Results (7896bccfca7cd02c29ccebc3c3024b508cbcdafb)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +110 -2
README.md CHANGED
@@ -1,8 +1,103 @@
1
  ---
 
2
  tags:
3
  - yi
4
  - moe
5
- license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  ---
7
 
8
  # Mixtral MOE 2x34B
@@ -100,4 +195,17 @@ As we continue our journey into the future, let us remember the importance of sa
100
  please input prompt:李开复是谁?
101
  李开复是谁?
102
  他是一个在人工智能领域有着卓越贡献的科学家,也是一位成功的企业家。他的名字与谷歌、微软等科技巨头紧密相连,他是创新工场的创始人之一,更是无数创业者心中的偶像和导师。然而,除了这些耀眼的光环之外,李开复还有着怎样的故事呢?让我们一起来揭秘这位传奇人物的人生历程吧!</s>
103
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
  tags:
4
  - yi
5
  - moe
6
+ model-index:
7
+ - name: Mixtral_34Bx2_MoE_60B
8
+ results:
9
+ - task:
10
+ type: text-generation
11
+ name: Text Generation
12
+ dataset:
13
+ name: IFEval (0-Shot)
14
+ type: HuggingFaceH4/ifeval
15
+ args:
16
+ num_few_shot: 0
17
+ metrics:
18
+ - type: inst_level_strict_acc and prompt_level_strict_acc
19
+ value: 45.38
20
+ name: strict accuracy
21
+ source:
22
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=cloudyu/Mixtral_34Bx2_MoE_60B
23
+ name: Open LLM Leaderboard
24
+ - task:
25
+ type: text-generation
26
+ name: Text Generation
27
+ dataset:
28
+ name: BBH (3-Shot)
29
+ type: BBH
30
+ args:
31
+ num_few_shot: 3
32
+ metrics:
33
+ - type: acc_norm
34
+ value: 41.21
35
+ name: normalized accuracy
36
+ source:
37
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=cloudyu/Mixtral_34Bx2_MoE_60B
38
+ name: Open LLM Leaderboard
39
+ - task:
40
+ type: text-generation
41
+ name: Text Generation
42
+ dataset:
43
+ name: MATH Lvl 5 (4-Shot)
44
+ type: hendrycks/competition_math
45
+ args:
46
+ num_few_shot: 4
47
+ metrics:
48
+ - type: exact_match
49
+ value: 6.57
50
+ name: exact match
51
+ source:
52
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=cloudyu/Mixtral_34Bx2_MoE_60B
53
+ name: Open LLM Leaderboard
54
+ - task:
55
+ type: text-generation
56
+ name: Text Generation
57
+ dataset:
58
+ name: GPQA (0-shot)
59
+ type: Idavidrein/gpqa
60
+ args:
61
+ num_few_shot: 0
62
+ metrics:
63
+ - type: acc_norm
64
+ value: 11.74
65
+ name: acc_norm
66
+ source:
67
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=cloudyu/Mixtral_34Bx2_MoE_60B
68
+ name: Open LLM Leaderboard
69
+ - task:
70
+ type: text-generation
71
+ name: Text Generation
72
+ dataset:
73
+ name: MuSR (0-shot)
74
+ type: TAUR-Lab/MuSR
75
+ args:
76
+ num_few_shot: 0
77
+ metrics:
78
+ - type: acc_norm
79
+ value: 17.78
80
+ name: acc_norm
81
+ source:
82
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=cloudyu/Mixtral_34Bx2_MoE_60B
83
+ name: Open LLM Leaderboard
84
+ - task:
85
+ type: text-generation
86
+ name: Text Generation
87
+ dataset:
88
+ name: MMLU-PRO (5-shot)
89
+ type: TIGER-Lab/MMLU-Pro
90
+ config: main
91
+ split: test
92
+ args:
93
+ num_few_shot: 5
94
+ metrics:
95
+ - type: acc
96
+ value: 41.85
97
+ name: accuracy
98
+ source:
99
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=cloudyu/Mixtral_34Bx2_MoE_60B
100
+ name: Open LLM Leaderboard
101
  ---
102
 
103
  # Mixtral MOE 2x34B
 
195
  please input prompt:李开复是谁?
196
  李开复是谁?
197
  他是一个在人工智能领域有着卓越贡献的科学家,也是一位成功的企业家。他的名字与谷歌、微软等科技巨头紧密相连,他是创新工场的创始人之一,更是无数创业者心中的偶像和导师。然而,除了这些耀眼的光环之外,李开复还有着怎样的故事呢?让我们一起来揭秘这位传奇人物的人生历程吧!</s>
198
+ ```
199
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
200
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_cloudyu__Mixtral_34Bx2_MoE_60B)
201
+
202
+ | Metric |Value|
203
+ |-------------------|----:|
204
+ |Avg. |27.42|
205
+ |IFEval (0-Shot) |45.38|
206
+ |BBH (3-Shot) |41.21|
207
+ |MATH Lvl 5 (4-Shot)| 6.57|
208
+ |GPQA (0-shot) |11.74|
209
+ |MuSR (0-shot) |17.78|
210
+ |MMLU-PRO (5-shot) |41.85|
211
+