JaeHyeong commited on
Commit
6e02a72
โ€ข
1 Parent(s): 5104702

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -14,6 +14,13 @@ license: cc-by-4.0
14
 
15
  # bespin-global/klue-sroberta-base-continue-learning-by-mnr
16
 
 
 
 
 
 
 
 
17
  This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
18
 
19
  <!--- Describe your model here -->
 
14
 
15
  # bespin-global/klue-sroberta-base-continue-learning-by-mnr
16
 
17
+ ํ•ด๋‹น ๋ชจ๋ธ์€ KLUE/NLI, KLUE/STS ๋ฐ์ดํ„ฐ์…‹์„ ํ™œ์šฉํ•˜์˜€์œผ๋ฉฐ, sentence-transformers์˜ ๊ณต์‹ ๋ฌธ์„œ ๋‚ด ์†Œ๊ฐœ๋œ [continue-learning](https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/sts/training_stsbenchmark_continue_training.py) ๋ฐฉ๋ฒ•์„ ํ†ตํ•ด ์•„๋ž˜์™€ ๊ฐ™์ด ํ•™์Šต๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
18
+ 1. NLI ๋ฐ์ดํ„ฐ์…‹์„ ํ†ตํ•ด nagative sampling ํ›„, MultipleNegativeRankingLoss๋ฅผ ํ™œ์šฉํ•˜์—ฌ 1์ฐจ NLI training ์ˆ˜ํ–‰
19
+ 2. 1์—์„œ ํ•™์Šต์™„๋ฃŒ ๋œ ๋ชจ๋ธ์— STS ๋ฐ์ดํ„ฐ์…‹์„ ํ†ตํ•ด, CosineSimilarityLoss๋ฅผ ํ™œ์šฉํ•˜์—ฌ 2์ฐจ STS training ์ˆ˜ํ–‰
20
+
21
+ ํ•™์Šต์— ๊ด€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ [Blog](https://velog.io/@jaehyeong/Basic-NLP-sentence-transformers-%EB%9D%BC%EC%9D%B4%EB%B8%8C%EB%9F%AC%EB%A6%AC%EB%A5%BC-%ED%99%9C%EC%9A%A9%ED%95%9C-SBERT-%ED%95%99%EC%8A%B5-%EB%B0%A9%EB%B2%95#225-continue-learning-by-sts)์™€ [Colab ์‹ค์Šต ์ฝ”๋“œ](https://colab.research.google.com/drive/1uDt3o_Nv2cTiVbIAIUkst_eOSD37Wkmf)๋ฅผ ์ฐธ๊ณ ํ•ด์ฃผ์„ธ์š”.
22
+
23
+ ---
24
  This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search.
25
 
26
  <!--- Describe your model here -->