File size: 1,457 Bytes
64bffaf c684a12 64bffaf d1f8282 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 |
---
license: cc-by-nc-4.0
---
Merge:
```shell
layer_slices:
- model: Gryphe/MythoMax-L2-13b
start: 0
end: 16
- model: Undi95/MM-ReMM-L2-20B-Part1
start: 8
end: 20
- model: Gryphe/MythoMax-L2-13b
start: 17
end: 32
- model: Undi95/MM-ReMM-L2-20B-Part1
start: 21
end: 40
```
<!-- description start -->
## Models used
- Gryphe/MythoMax-L2-13b
- Undi95/ReMM-v2.1-L2-13B
<!-- description end -->
Part1 = ReMM v2.1 merged /w MythoMax low weight to keep consistency. I call this "dilution" and result show consistency and coherency without repeat/loop beside the small amount of duplicated datas.
## Prompt template: Alpaca
```
Below is an instruction that describes a task. Write a response that completes the request.
### Instruction:
{prompt}
### Response:
```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Undi95__MM-ReMM-L2-20B)
| Metric | Value |
|-----------------------|---------------------------|
| Avg. | 51.14 |
| ARC (25-shot) | 60.84 |
| HellaSwag (10-shot) | 85.18 |
| MMLU (5-shot) | 56.45 |
| TruthfulQA (0-shot) | 53.33 |
| Winogrande (5-shot) | 75.77 |
| GSM8K (5-shot) | 7.73 |
| DROP (3-shot) | 18.66 |
|