Hugging Face's logo

ValiantLabs
/
Llama3.1-8B-ShiningValiant2

Text Generation
Safetensors
English
llama
shining-valiant
shining-valiant-2
valiant
valiant-labs
llama-3.1
llama-3.1-instruct
llama-3.1-instruct-8b
llama-3
llama-3-instruct
llama-3-instruct-8b
8b
science
physics
biology
chemistry
compsci
computer-science
engineering
technical
conversational
chat
instruct
Eval Results
Model card Files Community
6
sequelbox commited on
Commit
9dfdf81
•
1 Parent(s): c1d31d0

eval

Browse files
Files changed (1) hide show
  1. README.md +108 -0
README.md CHANGED
@@ -46,6 +46,114 @@ model-index:
46
  - type: acc
47
  value: 74.27
48
  name: acc
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  - task:
50
  type: text-generation
51
  name: Text Generation
 
46
  - type: acc
47
  value: 74.27
48
  name: acc
49
+ - task:
50
+ type: text-generation
51
+ name: Text Generation
52
+ dataset:
53
+ name: MMLU College Biology (5-Shot)
54
+ type: MMLU
55
+ args:
56
+ num_few_shot: 5
57
+ metrics:
58
+ - type: acc
59
+ value: 76.39
60
+ name: acc
61
+ - task:
62
+ type: text-generation
63
+ name: Text Generation
64
+ dataset:
65
+ name: MMLU High School Biology (5-Shot)
66
+ type: MMLU
67
+ args:
68
+ num_few_shot: 5
69
+ metrics:
70
+ - type: acc
71
+ value: 76.13
72
+ name: acc
73
+ - task:
74
+ type: text-generation
75
+ name: Text Generation
76
+ dataset:
77
+ name: MMLU College Chemistry (5-Shot)
78
+ type: MMLU
79
+ args:
80
+ num_few_shot: 5
81
+ metrics:
82
+ - type: acc
83
+ value: 47.0
84
+ name: acc
85
+ - task:
86
+ type: text-generation
87
+ name: Text Generation
88
+ dataset:
89
+ name: MMLU High School Chemistry (5-Shot)
90
+ type: MMLU
91
+ args:
92
+ num_few_shot: 5
93
+ metrics:
94
+ - type: acc
95
+ value: 51.23
96
+ name: acc
97
+ - task:
98
+ type: text-generation
99
+ name: Text Generation
100
+ dataset:
101
+ name: MMLU College Physics (5-Shot)
102
+ type: MMLU
103
+ args:
104
+ num_few_shot: 5
105
+ metrics:
106
+ - type: acc
107
+ value: 42.16
108
+ name: acc
109
+ - task:
110
+ type: text-generation
111
+ name: Text Generation
112
+ dataset:
113
+ name: MMLU High School Physics (5-Shot)
114
+ type: MMLU
115
+ args:
116
+ num_few_shot: 5
117
+ metrics:
118
+ - type: acc
119
+ value: 43.05
120
+ name: acc
121
+ - task:
122
+ type: text-generation
123
+ name: Text Generation
124
+ dataset:
125
+ name: MMLU College Computer Science (5-Shot)
126
+ type: MMLU
127
+ args:
128
+ num_few_shot: 5
129
+ metrics:
130
+ - type: acc
131
+ value: 52.0
132
+ name: acc
133
+ - task:
134
+ type: text-generation
135
+ name: Text Generation
136
+ dataset:
137
+ name: MMLU High School Computer Science (5-Shot)
138
+ type: MMLU
139
+ args:
140
+ num_few_shot: 5
141
+ metrics:
142
+ - type: acc
143
+ value: 69.0
144
+ name: acc
145
+ - task:
146
+ type: text-generation
147
+ name: Text Generation
148
+ dataset:
149
+ name: MMLU STEM (5-Shot)
150
+ type: MMLU
151
+ args:
152
+ num_few_shot: 5
153
+ metrics:
154
+ - type: acc
155
+ value: 54.46
156
+ name: acc
157
  - task:
158
  type: text-generation
159
  name: Text Generation