Update README.md
Browse files
README.md
CHANGED
@@ -17,8 +17,11 @@ widget:
|
|
17 |
|
18 |
Pretrained RoBERTa model on Finnish language using a masked language modeling (MLM) objective with WECHSEL method. RoBERTa was introduced in
|
19 |
[this paper](https://arxiv.org/abs/1907.11692) and first released in
|
20 |
-
[this repository](https://github.com/pytorch/fairseq/tree/master/examples/roberta).
|
21 |
-
|
|
|
|
|
|
|
22 |
|
23 |
## Model description
|
24 |
|
|
|
17 |
|
18 |
Pretrained RoBERTa model on Finnish language using a masked language modeling (MLM) objective with WECHSEL method. RoBERTa was introduced in
|
19 |
[this paper](https://arxiv.org/abs/1907.11692) and first released in
|
20 |
+
[this repository](https://github.com/pytorch/fairseq/tree/master/examples/roberta).
|
21 |
+
|
22 |
+
WECHSEL method (Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models) was introduced in [this paper](https://arxiv.org/abs/2112.06598) and first released in [this repository](https://github.com/CPJKU/wechsel).
|
23 |
+
|
24 |
+
This model is case-sensitive: it makes a difference between finnish and Finnish.
|
25 |
|
26 |
## Model description
|
27 |
|