File size: 1,729 Bytes
ab891d0
 
1c13f8b
 
 
 
 
ab891d0
a8c630d
 
0b80ff7
 
1c13f8b
 
 
 
a20a5ad
1c13f8b
 
 
1cbe2cd
 
 
 
 
5e083d8
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
---
license: llama2
datasets:
- garage-bAInd/Open-Platypus
- Open-Orca/OpenOrca
language:
- en
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6468ce47e134d050a58aa89c/SNX5IX0YqN_MUhUzdMjJc.png)

<a href="https://www.buymeacoffee.com/PulsarAI" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>

# OpenOrca-Platypus2-13B-QLoRA-0.80-epoch

Luban-Platypus2-13B-QLora-0.80-epoch is a merge of [ai-business/Luban-13B](https://huggingface.co/ai-business/Luban-13B) and [Platypus2-13B-QLoRA-0.80-epoch](https://huggingface.co/Weyaxi/Platypus2-13B-QLoRA-0.80-epoch)

# Evaluation Results ([Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard))

| Metric                | Value |
|-----------------------|-------|
| Avg.                  | 63,94 |
| ARC (25-shot)         | 60,24 |
| HellaSwag (10-shot)   | 82,22 |
| MMLU (5-shot)         | 58,03 |
| TruthfulQA (0-shot)   | 55,26 |

# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_TFLai__Luban-Platypus2-13B-QLora-0.80-epoch)

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | 49.28   |
| ARC (25-shot)         | 60.24          |
| HellaSwag (10-shot)   | 82.22    |
| MMLU (5-shot)         | 58.03         |
| TruthfulQA (0-shot)   | 55.26   |
| Winogrande (5-shot)   | 75.37   |
| GSM8K (5-shot)        | 0.91        |
| DROP (3-shot)         | 12.95         |