File size: 746 Bytes
74fafab |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
https://wandb.ai/open-assistant/supervised-finetuning/runs/uwqcwaau
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_dvruette__oasst-pythia-12b-flash-attn-5000-steps)
| Metric | Value |
|-----------------------|---------------------------|
| Avg. | 35.69 |
| ARC (25-shot) | 44.97 |
| HellaSwag (10-shot) | 69.75 |
| MMLU (5-shot) | 26.64 |
| TruthfulQA (0-shot) | 38.89 |
| Winogrande (5-shot) | 63.14 |
| GSM8K (5-shot) | 0.99 |
| DROP (3-shot) | 5.48 |
|