Hugging Face's logo

vicgalle
/
RoleBeagle-11B

Text Generation
Transformers
Safetensors
mistral
roleplay
rp
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
2
vicgalle commited on
Commit
91b2ab1
•
1 Parent(s): 33938df

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -8
README.md CHANGED
@@ -21,7 +21,8 @@ model-index:
21
  value: 72.35
22
  name: normalized accuracy
23
  source:
24
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
 
25
  name: Open LLM Leaderboard
26
  - task:
27
  type: text-generation
@@ -37,7 +38,8 @@ model-index:
37
  value: 89.77
38
  name: normalized accuracy
39
  source:
40
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
 
41
  name: Open LLM Leaderboard
42
  - task:
43
  type: text-generation
@@ -54,7 +56,8 @@ model-index:
54
  value: 66.35
55
  name: accuracy
56
  source:
57
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
 
58
  name: Open LLM Leaderboard
59
  - task:
60
  type: text-generation
@@ -70,7 +73,8 @@ model-index:
70
  - type: mc2
71
  value: 77.92
72
  source:
73
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
 
74
  name: Open LLM Leaderboard
75
  - task:
76
  type: text-generation
@@ -87,7 +91,8 @@ model-index:
87
  value: 84.06
88
  name: accuracy
89
  source:
90
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
 
91
  name: Open LLM Leaderboard
92
  - task:
93
  type: text-generation
@@ -104,8 +109,12 @@ model-index:
104
  value: 65.88
105
  name: accuracy
106
  source:
107
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
 
108
  name: Open LLM Leaderboard
 
 
 
109
  ---
110
 
111
  # RoleBeagle-11B
@@ -124,5 +133,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
124
  |MMLU (5-Shot) |66.35|
125
  |TruthfulQA (0-shot) |77.92|
126
  |Winogrande (5-shot) |84.06|
127
- |GSM8k (5-shot) |65.88|
128
-
 
21
  value: 72.35
22
  name: normalized accuracy
23
  source:
24
+ url: >-
25
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
26
  name: Open LLM Leaderboard
27
  - task:
28
  type: text-generation
 
38
  value: 89.77
39
  name: normalized accuracy
40
  source:
41
+ url: >-
42
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
43
  name: Open LLM Leaderboard
44
  - task:
45
  type: text-generation
 
56
  value: 66.35
57
  name: accuracy
58
  source:
59
+ url: >-
60
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
61
  name: Open LLM Leaderboard
62
  - task:
63
  type: text-generation
 
73
  - type: mc2
74
  value: 77.92
75
  source:
76
+ url: >-
77
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
78
  name: Open LLM Leaderboard
79
  - task:
80
  type: text-generation
 
91
  value: 84.06
92
  name: accuracy
93
  source:
94
+ url: >-
95
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
96
  name: Open LLM Leaderboard
97
  - task:
98
  type: text-generation
 
109
  value: 65.88
110
  name: accuracy
111
  source:
112
+ url: >-
113
+ https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=vicgalle/RoleBeagle-11B
114
  name: Open LLM Leaderboard
115
+ tags:
116
+ - roleplay
117
+ - rp
118
  ---
119
 
120
  # RoleBeagle-11B
 
133
  |MMLU (5-Shot) |66.35|
134
  |TruthfulQA (0-shot) |77.92|
135
  |Winogrande (5-shot) |84.06|
136
+ |GSM8k (5-shot) |65.88|