Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,20 @@ model-index:
|
|
| 13 |
should probably proofread and complete it, then remove this comment. -->
|
| 14 |
|
| 15 |
# core-350
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [./core-350](https://huggingface.co/./core-350) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
|
|
|
| 13 |
should probably proofread and complete it, then remove this comment. -->
|
| 14 |
|
| 15 |
# core-350
|
| 16 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 17 |
+
|-------------|------:|--------|-----:|---|-----:|
|
| 18 |
+
|arc_challenge| 0|acc |0.2048|± |0.0118|
|
| 19 |
+
| | |acc_norm|0.2509|± |0.0127|
|
| 20 |
+
|arc_easy | 0|acc |0.4247|± |0.0101|
|
| 21 |
+
| | |acc_norm|0.3965|± |0.0100|
|
| 22 |
+
|boolq | 1|acc |0.5468|± |0.0087|
|
| 23 |
+
|hellaswag | 0|acc |0.2844|± |0.0045|
|
| 24 |
+
| | |acc_norm|0.3031|± |0.0046|
|
| 25 |
+
|openbookqa | 0|acc |0.1560|± |0.0162|
|
| 26 |
+
| | |acc_norm|0.2660|± |0.0198|
|
| 27 |
+
|piqa | 0|acc |0.5854|± |0.0115|
|
| 28 |
+
| | |acc_norm|0.5762|± |0.0115|
|
| 29 |
+
|winogrande | 0|acc |0.4909|± |0.0141|
|
| 30 |
|
| 31 |
This model is a fine-tuned version of [./core-350](https://huggingface.co/./core-350) on an unknown dataset.
|
| 32 |
It achieves the following results on the evaluation set:
|