stabilityai
/

stablelm-zephyr-3b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

pvduy commited on Dec 2, 2023

Commit

cdce2c8

•

1 Parent(s): 2bcee4b

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -100,9 +100,9 @@ The dataset is comprised of a mixture of open datasets large-scale datasets avai
 ## Other benchmark:
 | Metric                | Value                     |
 |-----------------------|---------------------------|
-| ARC (25-shot)         |  0.47       |
-| HellaSwag (10-shot)   | 0.7421    |
-| MMLU (5-shot)        |   0.4627     |
 | TruthfulQA (0-shot)   |    |
 | Winogrande (5-shot)   |   0.655 |
 | GSM8K (5-shot)        | 0.423        |

 ## Other benchmark:
 | Metric                | Value                     |
 |-----------------------|---------------------------|
+| ARC (25-shot)         |  0.470       |
+| HellaSwag (10-shot)   | 0.742    |
+| MMLU (5-shot)        |   0.463     |
 | TruthfulQA (0-shot)   |    |
 | Winogrande (5-shot)   |   0.655 |
 | GSM8K (5-shot)        | 0.423        |