Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,12 @@ language:
|
|
12 |
- STS : seed=111,epoch=10, lr=1e-4, eps=1e-6, warm_step=10%, max_seq_len=128, train_batch=128(small ๋ชจ๋ธ=32) (albert 13m/7G) [ํ๋ จ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-nli.ipynb)
|
13 |
- NLI ํ๋ จ : seed=111,epoch=3, lr=3e-5, eps=1e-8, warm_step=10%, max_seq_len=128, train_batch=64, eval_bath=64(albert 2h/7G) [ํ๋ จ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-sts.ipynb)
|
14 |
- [ํ๊ฐ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test3.ipynb),[ํ
์คํธ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test.ipynb)
|
15 |
-
|
|
|
|
|
|
|
|
|
|
|
16 |
## Usage and Performance
|
17 |
|
18 |
Pre-trained models can be used like this:
|
|
|
12 |
- STS : seed=111,epoch=10, lr=1e-4, eps=1e-6, warm_step=10%, max_seq_len=128, train_batch=128(small ๋ชจ๋ธ=32) (albert 13m/7G) [ํ๋ จ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-nli.ipynb)
|
13 |
- NLI ํ๋ จ : seed=111,epoch=3, lr=3e-5, eps=1e-8, warm_step=10%, max_seq_len=128, train_batch=64, eval_bath=64(albert 2h/7G) [ํ๋ จ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-corossencoder-train-sts.ipynb)
|
14 |
- [ํ๊ฐ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test3.ipynb),[ํ
์คํธ์ฝ๋](https://github.com/kobongsoo/BERT/blob/master/sbert/cross-encoder/sbert-crossencoder-test.ipynb)
|
15 |
+
|
16 |
+
-
|
17 |
+
|๋ชจ๋ธ |korsts|klue-sts|glue(stsb)|stsb_multi_mt(en)|
|
18 |
+
|:--------|------:|--------:|--------------:|------------:|
|
19 |
+
|**albert-small-kor-cross-encoder-v1** |0.8455 |0.8526 |0.8513 |0.7976|
|
20 |
+
|
21 |
## Usage and Performance
|
22 |
|
23 |
Pre-trained models can be used like this:
|