kyujinpy commited on
Commit
99b6c20
1 Parent(s): 0385ad7

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -62,7 +62,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
62
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.7436 | 0.7927 | 0.8037 | 0.8259 |
63
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.7509 | 0.7899 | 0.8029 | 0.8290 |
64
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.7517 | 0.7868 | 0.8009 | 0.8239 |
65
- | **Poly-platypus-ko-12.8b(ours)** | 0.7876 | NaN | NaN | NaN |
66
 
67
  > Natural Language Inference (NLI; 자연어 추론 평가)
68
  ### HellaSwag (F1)
@@ -74,7 +74,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
74
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4562 | 0.4657 | 0.4698 | 0.4774 |
75
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.4571 | 0.4461 | 0.4371 | 0.4525 |
76
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.4432 | 0.4382 | 0.4550 | 0.4534 |
77
- | **Poly-platypus-ko-12.8b(ours)** | 0.4838 | NaN | NaN | NaN |
78
 
79
  > Question Answering (QA)
80
  ### BoolQ (F1)
@@ -86,7 +86,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
86
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.5786 | 0.6977 | 0.7084 | 0.7144 |
87
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.6028 | 0.6979 | 0.7016 | 0.6988 |
88
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6142 | 0.6757 | 0.6839 | 0.6878 |
89
- | **Poly-platypus-ko-12.8b(ours)** | 0.4888 | NaN | NaN | NaN |
90
 
91
  > Classification
92
  ### SentiNeg (F1)
@@ -98,7 +98,7 @@ I use A100 GPU 40GB and COLAB, when trianing.
98
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4594 | 0.7611 | 0.7276 | 0.9370 |
99
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.5821 | 0.7653 | 0.7991 | 0.8643 |
100
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6127 | 0.7199 | 0.7531 | 0.8381 |
101
- | **Poly-platypus-ko-12.8b(ours)** | 0.8490 | NaN | NaN | NaN |
102
 
103
  # Implementation Code
104
  ```python
 
62
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.7436 | 0.7927 | 0.8037 | 0.8259 |
63
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.7509 | 0.7899 | 0.8029 | 0.8290 |
64
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.7517 | 0.7868 | 0.8009 | 0.8239 |
65
+ | **Poly-platypus-ko-12.8b(ours)** | 0.7876 | 0.8099 | NaN | NaN |
66
 
67
  > Natural Language Inference (NLI; 자연어 추론 평가)
68
  ### HellaSwag (F1)
 
74
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4562 | 0.4657 | 0.4698 | 0.4774 |
75
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.4571 | 0.4461 | 0.4371 | 0.4525 |
76
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.4432 | 0.4382 | 0.4550 | 0.4534 |
77
+ | **Poly-platypus-ko-12.8b(ours)** | 0.4838 | 0.4858 | NaN | NaN |
78
 
79
  > Question Answering (QA)
80
  ### BoolQ (F1)
 
86
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.5786 | 0.6977 | 0.7084 | 0.7144 |
87
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.6028 | 0.6979 | 0.7016 | 0.6988 |
88
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6142 | 0.6757 | 0.6839 | 0.6878 |
89
+ | **Poly-platypus-ko-12.8b(ours)** | 0.4888 | 0.6520 | NaN | NaN |
90
 
91
  > Classification
92
  ### SentiNeg (F1)
 
98
  | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.4594 | 0.7611 | 0.7276 | 0.9370 |
99
  | [KO-platypus2-7B-EX](https://huggingface.co/kyujinpy/KO-Platypus2-7B-ex) | 0.5821 | 0.7653 | 0.7991 | 0.8643 |
100
  | [KoT-platypus2-7B](https://huggingface.co/kyujinpy/KoT-platypus2-7B) | 0.6127 | 0.7199 | 0.7531 | 0.8381 |
101
+ | **Poly-platypus-ko-12.8b(ours)** | 0.8490 | 0.9597 | NaN | NaN |
102
 
103
  # Implementation Code
104
  ```python