Update README.md
Browse files
README.md
CHANGED
@@ -46,7 +46,7 @@ language:
|
|
46 |
|
47 |
# Model Card for EntityCS-39-MLM-xlmr-base
|
48 |
|
49 |
-
This model has been trained on the EntityCS corpus,
|
50 |
The corpus can be found in [https://huggingface.co/huawei-noah/entity_cs](https://huggingface.co/huawei-noah/entity_cs), check the link for more details.
|
51 |
|
52 |
Firstly, we employ the conventional 80-10-10 MLM objective, where 15% of sentence subwords are considered as masking candidates. From those, we replace subwords
|
|
|
46 |
|
47 |
# Model Card for EntityCS-39-MLM-xlmr-base
|
48 |
|
49 |
+
This model has been trained on the EntityCS corpus, an English corpus from Wikipedia with replaced entities in different languages.
|
50 |
The corpus can be found in [https://huggingface.co/huawei-noah/entity_cs](https://huggingface.co/huawei-noah/entity_cs), check the link for more details.
|
51 |
|
52 |
Firstly, we employ the conventional 80-10-10 MLM objective, where 15% of sentence subwords are considered as masking candidates. From those, we replace subwords
|