File size: 1,116 Bytes
2335683 4f9f2bc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
---
license: llama2
language:
- en
tags:
- llama
---
Chat model with a storytelling bent.
Recipe:
* [Chronorctypus-Limarobormes](https://huggingface.co/chargoddard/Chronorctypus-Limarobormes-13b) base
* a healthy SLERPing of [ReMM-v2.2-L2-13B](https://huggingface.co/Undi95/ReMM-v2.2-L2-13B)
* [Llama-2-13B-Storywriter](https://huggingface.co/Blackroot/Llama-2-13B-Storywriter-LORA) x 0.5
* WIP storytelling LORA
Responds well to the Alpaca prompt format.
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_chargoddard__storytime-13b)
| Metric | Value |
|-----------------------|---------------------------|
| Avg. | 50.55 |
| ARC (25-shot) | 62.03 |
| HellaSwag (10-shot) | 83.96 |
| MMLU (5-shot) | 57.48 |
| TruthfulQA (0-shot) | 52.5 |
| Winogrande (5-shot) | 75.53 |
| GSM8K (5-shot) | 8.34 |
| DROP (3-shot) | 14.0 |
|