|
--- |
|
library_name: transformers |
|
license: mit |
|
datasets: |
|
- klue |
|
- dkoterwa/kor-sts |
|
language: |
|
- ko |
|
pipeline_tag: sentence-similarity |
|
--- |
|
# KF-DeBERTa-base-cross-STS |
|
|
|
pre-trained model: KF-DeBERTa-base-cross-NLI {https://huggingface.co/deliciouscat/kf-deberta-base-cross-nli} |
|
|
|
trained data: |
|
- `klue/sts`: 1epoch |
|
- `dkoterwa/kor-sts`: 2epoch |
|
|
|
|
|
label scaling: 0~5 -> -1->1 |
|
bi-encoder STS ํ์ต์ ์ํ dataset augmentation์ ์์ ํ๊ณ ํ๋ จํ์์ต๋๋ค. {https://arxiv.org/abs/2010.08240} |
|
|
|
cosine similarity๋ก ํ์ตํ ์ ์๋๋ก scaling ๋ output์ด ์ถ๋ก ๋ฉ๋๋ค. |