Update README.md
Browse files
README.md
CHANGED
|
@@ -32,7 +32,19 @@ text = "<s>[INST] μμ΄μ λ΄ν΄μ μ
μ μ μλ €μ€. [/INST] "
|
|
| 32 |
|
| 33 |
# **Model Benchmark**
|
| 34 |
|
| 35 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
# Implementation Code
|
| 38 |
|
|
|
|
| 32 |
|
| 33 |
# **Model Benchmark**
|
| 34 |
|
| 35 |
+
ꡬλ¦v2 repo μμ μ 곡λλ λ°μ΄ν°μ
κ³Ό ν둬ννΈλ₯Ό μ¬μ©νμ¬ νκ°νμ΅λλ€.
|
| 36 |
+
λΉμ GPT4μ νμ¬ GPT4κ° μμ ν λμΌνμ§λ μκΈ°μ μ€μ κ²°κ³Όμ μ½κ°μ μ°¨μ΄κ° μ‘΄μ¬ ν μ μμ΅λλ€.
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
| Model | μ΄ν΄κ°λ₯μ± | μμ°μ€λ¬μ | λ§₯λ½μ μ§ | ν₯λ―Έλ‘μ | μ§μμ΄μ¬μ© | μ λ°μ ν리ν°
|
| 40 |
+
| --- | --- | --- | --- | --- | --- | ---
|
| 41 |
+
| GPT-3.5 | 0.980 | 2.806 | 2.849 | 2.056 | 0.917 | 3.905
|
| 42 |
+
| GPT-4 | 0.984 | 2.897 | 2.944 | 2.143 | 0.968 | 4.083
|
| 43 |
+
| KoAlpaca v1.1 | 0.651 | 1.909 | 1.901 | 1.583 | 0.385 | 2.575
|
| 44 |
+
| koVicuna | 0.460 | 1.583 | 1.726 | 1.528 | 0.409 | 2.440
|
| 45 |
+
| KULLM v2 | 0.742 | 2.083 | 2.107 | 1.794 | 0.548 | 3.036
|
| 46 |
+
| **Synatra-V0.1-7B** | **0.960** | **2.821** | **2.755** | **2.356** | **0.934** | **4.065**
|
| 47 |
+
|
| 48 |
|
| 49 |
# Implementation Code
|
| 50 |
|