Hugging Face's logo

oneonlee
/
KoSOLAR-v0.2-gugutypus-10.7B

Text Generation
Transformers
Safetensors
English
Korean
llama
text-generation-inference
Inference Endpoints
Model card Files Community
oneonlee commited on
Commit
3936777
·
verified ·
1 Parent(s): 06f17be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -10
README.md CHANGED
@@ -60,8 +60,11 @@ pipeline_tag: text-generation
60
  |BoolQ | 2|none | 5|acc | |± | |
61
  |COPA | 1|none | 0|acc |0.8300|± |0.0378|
62
  |COPA | 1|none | 5|acc | |± | |
 
 
63
  |MMLU |N/A |none | 0|acc |0.5826|± |0.1432|
64
  |MMLU |N/A |none | 5|acc | |± | |
 
65
  <!--| - humanities |N/A |none | 0|acc |0.5103|± |0.1669|
66
  | - other |N/A |none | 0|acc |0.6662|± |0.1079|
67
  | - social_sciences|N/A |none | 0|acc |0.6922|± |0.0979|
@@ -74,16 +77,18 @@ pipeline_tag: text-generation
74
 
75
  | Tasks |Version|Filter|n-shot|Metric|Value | |Stderr|
76
  |-------------------------|-------|------|-----:|------|-----:|---|-----:|
77
- |KoBEST-HellaSwag | |none | 0|acc | |± | |
78
- |KoBEST-HellaSwag | |none | 5|acc | |± | |
79
- |KoBEST-BoolQ | |none | 0|acc | |± | |
80
- |KoBEST-BoolQ | |none | 5|acc | |± | |
81
- |KoBEST-COPA | |none | 0|acc | |± | |
82
- |KoBEST-COPA | |none | 5|acc | |± | |
83
- |KoBEST-SentiNeg | |none | 0|acc | |± | |
84
- |KoBEST-SentiNeg | |none | 5|acc | |± | |
85
- |KoBEST-MMLU | |none | 0|acc | |± | |
86
- |KoBEST-MMLU | |none | 5|acc | |± | |
 
 
87
 
88
 
89
  ---
 
60
  |BoolQ | 2|none | 5|acc | |± | |
61
  |COPA | 1|none | 0|acc |0.8300|± |0.0378|
62
  |COPA | 1|none | 5|acc | |± | |
63
+ |truthfulqa |N/A |none | 0|acc |0.4249|± |0.0023|
64
+ |truthfulqa |N/A |none | 5|acc | |± | |
65
  |MMLU |N/A |none | 0|acc |0.5826|± |0.1432|
66
  |MMLU |N/A |none | 5|acc | |± | |
67
+
68
  <!--| - humanities |N/A |none | 0|acc |0.5103|± |0.1669|
69
  | - other |N/A |none | 0|acc |0.6662|± |0.1079|
70
  | - social_sciences|N/A |none | 0|acc |0.6922|± |0.0979|
 
77
 
78
  | Tasks |Version|Filter|n-shot|Metric|Value | |Stderr|
79
  |-------------------------|-------|------|-----:|------|-----:|---|-----:|
80
+ |KMMLU |N/A |none | 0|acc |0.3335|± |0.0475|
81
+ |KMMLU |N/A |none | 5|acc | |± | |
82
+ |KoBEST-HellaSwag | 0|none | 0|acc |0.4360|± |0.0222|
83
+ |KoBEST-HellaSwag | 0|none | 5|acc |0.4420|± |0.0222|
84
+ |KoBEST-BoolQ | 0|none | 0|acc |0.5064|± |0.0133|
85
+ |KoBEST-BoolQ | 0|none | 5|acc |0.8583|± |0.0093|
86
+ |KoBEST-COPA | 0|none | 0|acc |0.6040|± |0.0155|
87
+ |KoBEST-COPA | 0|none | 5|acc |0.7610|± |0.0135|
88
+ |KoBEST-SentiNeg | 0|none | 0|acc |0.5844|± |0.0248|
89
+ |KoBEST-SentiNeg | 0|none | 5|acc |0.9471|± |0.0112|
90
+ |KoBEST-MMLU | 0|none | 0|acc | |± | |
91
+ |KoBEST-MMLU | 0|none | 5|acc | |± | |
92
 
93
 
94
  ---