Adding Evaluation Results (#1)
Browse files- Adding Evaluation Results (74478d51f71f192f56ae9b32edd12402b930c608)
README.md
CHANGED
|
@@ -437,4 +437,16 @@ These are the [latest results from run 2024-01-04T14:09:43.780941](https://huggi
|
|
| 437 |
"acc_stderr": 0.013107179054313398
|
| 438 |
}
|
| 439 |
}
|
| 440 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 437 |
"acc_stderr": 0.013107179054313398
|
| 438 |
}
|
| 439 |
}
|
| 440 |
+
```
|
| 441 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 442 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_gagan3012__MetaModel)
|
| 443 |
+
|
| 444 |
+
| Metric | Value |
|
| 445 |
+
|-----------------------|---------------------------|
|
| 446 |
+
| Avg. | 74.4 |
|
| 447 |
+
| ARC (25-shot) | 71.08 |
|
| 448 |
+
| HellaSwag (10-shot) | 88.45 |
|
| 449 |
+
| MMLU (5-shot) | 66.26 |
|
| 450 |
+
| TruthfulQA (0-shot) | 71.84 |
|
| 451 |
+
| Winogrande (5-shot) | 83.43 |
|
| 452 |
+
| GSM8K (5-shot) | 65.35 |
|