Update README.md
Browse files
README.md
CHANGED
@@ -42,17 +42,32 @@ Multi Similarity Loss๋ฅผ ์ด์ฉํด **๋์ผํ ์ฝ๋์ ์ฉ์ด** ๊ฐ์ ๋์
|
|
42 |
**(2) Dense Passage Retrieval (DPR)**
|
43 |
|
44 |
SapBERT-KO-EN์ ๊ฒ์ ๋ชจ๋ธ๋ก ๋ง๋ค๊ธฐ ์ํด ์ถ๊ฐ์ ์ธ Fine-tuning์ ํด์ผ ํฉ๋๋ค.
|
45 |
-
Bi-Encoder ๊ตฌ์กฐ๋ก ์ง์์ ํ
์คํธ์ ์ ์ฌ๋๋ฅผ ๊ณ์ฐํ๋ DPR ๋ฐฉ์์ผ๋ก Fine-tuning
|
46 |
|
47 |
- Github : [https://github.com/snumin44/DPR-KO](https://github.com/snumin44/DPR-KO)
|
48 |
|
49 |
## 3. Training
|
50 |
|
51 |
-
**(1)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
52 |
|
|
|
53 |
|
54 |
|
55 |
-
**(2) Training**
|
56 |
|
57 |
|
58 |
## 4. Example
|
|
|
42 |
**(2) Dense Passage Retrieval (DPR)**
|
43 |
|
44 |
SapBERT-KO-EN์ ๊ฒ์ ๋ชจ๋ธ๋ก ๋ง๋ค๊ธฐ ์ํด ์ถ๊ฐ์ ์ธ Fine-tuning์ ํด์ผ ํฉ๋๋ค.
|
45 |
+
Bi-Encoder ๊ตฌ์กฐ๋ก ์ง์์ ํ
์คํธ์ ์ ์ฌ๋๋ฅผ ๊ณ์ฐํ๋ DPR ๋ฐฉ์์ผ๋ก Fine-tuning ํ์ต๋๋ค.
|
46 |
|
47 |
- Github : [https://github.com/snumin44/DPR-KO](https://github.com/snumin44/DPR-KO)
|
48 |
|
49 |
## 3. Training
|
50 |
|
51 |
+
**(1) Self Alignment Pretraining (SAP)**
|
52 |
+
|
53 |
+
SapBERT-KO-EN ํ์ต์ ํ์ฉํ ๋ฒ ์ด์ค ๋ชจ๋ธ ๋ฐ ํ์ดํผ ํ๋ผ๋ฏธํฐ๋ ๋ค์๊ณผ ๊ฐ์ต๋๋ค.
|
54 |
+
ํยท์ ์๋ฃ ์ฉ์ด๋ฅผ ์๋กํ ์๋ฃ ์ฉ์ด ์ฌ์ ์ธ **KOSTOM**์ ํ์ต ๋ฐ์ดํฐ๋ก ์ฌ์ฉํ์ต๋๋ค.
|
55 |
+
|
56 |
+
- Model : klue/bert-base
|
57 |
+
- Dataset : **KOSTOM**
|
58 |
+
- Epochs : 1
|
59 |
+
- Batch Size : 64
|
60 |
+
- Max Length : 64
|
61 |
+
- Dropout : 0.1
|
62 |
+
- Pooler : 'cls'
|
63 |
+
- Eval Step : 100
|
64 |
+
- Threshold : 0.8
|
65 |
+
- Scale Positive Sample : 1
|
66 |
+
- Scale Negative Sample : 60
|
67 |
|
68 |
+
**(2) Dense Passage Retrieval (DPR)**
|
69 |
|
70 |
|
|
|
71 |
|
72 |
|
73 |
## 4. Example
|