bongsoo commited on
Commit
c6ea538
โ€ข
1 Parent(s): 94f7820

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -12,7 +12,12 @@ language:
12
  - STS : seed=111,epoch=10, lr=1e-4, eps=1e-6, warm_step=10%, max_seq_len=128, train_batch=128(small ๋ชจ๋ธ=32) (albert 13m/7G) [ํ›ˆ๋ จ์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-nli.ipynb)
13
  - NLI ํ›ˆ๋ จ : seed=111,epoch=3, lr=3e-5, eps=1e-8, warm_step=10%, max_seq_len=128, train_batch=64, eval_bath=64(albert 2h/7G) [ํ›ˆ๋ จ์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-sts.ipynb)
14
  - [ํ‰๊ฐ€์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test3.ipynb),[ํ…Œ์ŠคํŠธ์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test.ipynb)
15
-
 
 
 
 
 
16
  ## Usage and Performance
17
 
18
  Pre-trained models can be used like this:
 
12
  - STS : seed=111,epoch=10, lr=1e-4, eps=1e-6, warm_step=10%, max_seq_len=128, train_batch=128(small ๋ชจ๋ธ=32) (albert 13m/7G) [ํ›ˆ๋ จ์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-nli.ipynb)
13
  - NLI ํ›ˆ๋ จ : seed=111,epoch=3, lr=3e-5, eps=1e-8, warm_step=10%, max_seq_len=128, train_batch=64, eval_bath=64(albert 2h/7G) [ํ›ˆ๋ จ์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-sts.ipynb)
14
  - [ํ‰๊ฐ€์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test3.ipynb),[ํ…Œ์ŠคํŠธ์ฝ”๋“œ](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test.ipynb)
15
+
16
+ -
17
+ |๋ชจ๋ธ |korsts|klue-sts|glue(stsb)|stsb_multi_mt(en)|
18
+ |:--------|------:|--------:|--------------:|------------:|
19
+ |**albert-small-kor-cross-encoder-v1** |0.8455 |0.8526 |0.8513 |0.7976|
20
+
21
  ## Usage and Performance
22
 
23
  Pre-trained models can be used like this: