Upload README.md
Browse files
README.md
CHANGED
@@ -62,7 +62,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
|
|
62 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.7436 | 0.7927 | 0.8037 | 0.8259 |
|
63 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.7509 | 0.7899 | 0.8029 | 0.8290 |
|
64 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.7517 | 0.7868 | 0.8009 | 0.8239 |
|
65 |
-
| **Poly-platypus-ko-12.8b(ours)** | 0.7876 |
|
66 |
|
67 |
> Natural Language Inference (NLI; 자연어 추론 평가)
|
68 |
### HellaSwag (F1)
|
@@ -74,7 +74,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
|
|
74 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4562 | 0.4657 | 0.4698 | 0.4774 |
|
75 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.4571 | 0.4461 | 0.4371 | 0.4525 |
|
76 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.4432 | 0.4382 | 0.4550 | 0.4534 |
|
77 |
-
| **Poly-platypus-ko-12.8b(ours)** | 0.4838 |
|
78 |
|
79 |
> Question Answering (QA)
|
80 |
### BoolQ (F1)
|
@@ -86,7 +86,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
|
|
86 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.5786 | 0.6977 | 0.7084 | 0.7144 |
|
87 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.6028 | 0.6979 | 0.7016 | 0.6988 |
|
88 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6142 | 0.6757 | 0.6839 | 0.6878 |
|
89 |
-
| **Poly-platypus-ko-12.8b(ours)** | 0.4888 |
|
90 |
|
91 |
> Classification
|
92 |
### SentiNeg (F1)
|
@@ -98,7 +98,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
|
|
98 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4594 | 0.7611 | 0.7276 | 0.9370 |
|
99 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.5821 | 0.7653 | 0.7991 | 0.8643 |
|
100 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6127 | 0.7199 | 0.7531 | 0.8381 |
|
101 |
-
| **Poly-platypus-ko-12.8b(ours)** | 0.8490 |
|
102 |
|
103 |
# Implementation Code
|
104 |
```python
|
|
|
62 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.7436 | 0.7927 | 0.8037 | 0.8259 |
|
63 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.7509 | 0.7899 | 0.8029 | 0.8290 |
|
64 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.7517 | 0.7868 | 0.8009 | 0.8239 |
|
65 |
+
| **Poly-platypus-ko-12.8b(ours)** | 0.7876 | 0.8099 | NaN | NaN |
|
66 |
|
67 |
> Natural Language Inference (NLI; 자연어 추론 평가)
|
68 |
### HellaSwag (F1)
|
|
|
74 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4562 | 0.4657 | 0.4698 | 0.4774 |
|
75 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.4571 | 0.4461 | 0.4371 | 0.4525 |
|
76 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.4432 | 0.4382 | 0.4550 | 0.4534 |
|
77 |
+
| **Poly-platypus-ko-12.8b(ours)** | 0.4838 | 0.4858 | NaN | NaN |
|
78 |
|
79 |
> Question Answering (QA)
|
80 |
### BoolQ (F1)
|
|
|
86 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.5786 | 0.6977 | 0.7084 | 0.7144 |
|
87 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.6028 | 0.6979 | 0.7016 | 0.6988 |
|
88 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6142 | 0.6757 | 0.6839 | 0.6878 |
|
89 |
+
| **Poly-platypus-ko-12.8b(ours)** | 0.4888 | 0.6520 | NaN | NaN |
|
90 |
|
91 |
> Classification
|
92 |
### SentiNeg (F1)
|
|
|
98 |
| [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4594 | 0.7611 | 0.7276 | 0.9370 |
|
99 |
| [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.5821 | 0.7653 | 0.7991 | 0.8643 |
|
100 |
| [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6127 | 0.7199 | 0.7531 | 0.8381 |
|
101 |
+
| **Poly-platypus-ko-12.8b(ours)** | 0.8490 | 0.9597 | NaN | NaN |
|
102 |
|
103 |
# Implementation Code
|
104 |
```python
|