bongsoo commited on
Commit
508b80e
โ€ข
1 Parent(s): cc37146

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -6
README.md CHANGED
@@ -1,13 +1,18 @@
1
  ---
2
  license: apache-2.0
 
 
3
  ---
4
- # Cross-Encoder for Quora Duplicate Questions Detection
5
- This model was trained using [SentenceTransformers](https://sbert.net) [Cross-Encoder](https://www.sbert.net/examples/applications/cross-encoder/README.html) class.
6
-
7
- ## Training Data
8
- This model was trained on the [STS benchmark dataset](http://ixa2.si.ehu.eus/stswiki/index.php/STSbenchmark). The model will predict a score between 0 and 1 how for the semantic similarity of two sentences.
9
-
10
 
 
 
 
 
 
 
11
  ## Usage and Performance
12
 
13
  Pre-trained models can be used like this:
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - ko
5
  ---
6
+ # albert-small-kor-cross-encoder-v1
7
+ - albert-small-kor-v1 ๋ชจ๋ธ์„ ํ›ˆ๋ จ์‹œ์ผœ cross-encoder๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ ๋ชจ๋ธ
8
+ - This model was trained using [SentenceTransformers](https://sbert.net) [Cross-Encoder](https://www.sbert.net/examples/applications/cross-encoder/README.html) class.
 
 
 
9
 
10
+ # Training
11
+ - sts(10)-nli(3)-sts(10)-nli(3)-sts(10)
12
+ - STS : seed=111,epoch=10, lr=1e-4, eps=1e-6, warm_step=10%, max_seq_len=128, train_batch=128(small ๋ชจ๋ธ=32) (albert 13m/7G) [์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-nli.ipynb)
13
+ - NLI ํ›ˆ๋ จ : seed=111,epoch=3, lr=3e-5, eps=1e-8, warm_step=10%, max_seq_len=128, train_batch=64, eval_bath=64(albert 2h/7G) [์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-sts.ipynb)
14
+ - [ํ‰๊ฐ€์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test3.ipynb)
15
+
16
  ## Usage and Performance
17
 
18
  Pre-trained models can be used like this: