Merge branch 'main' of https://huggingface.co/flax-community/bertin-roberta-large-spanish into main
Browse files
README.md
CHANGED
|
@@ -9,6 +9,8 @@ widget:
|
|
| 9 |
- text: "Fui a la librería a comprar un <mask>."
|
| 10 |
---
|
| 11 |
|
|
|
|
|
|
|
| 12 |
# BERTIN
|
| 13 |
|
| 14 |
BERTIN is a series of BERT-based models for Spanish. This one is a RoBERTa-large model trained from scratch on the Spanish portion of mC4 using [Flax](https://github.com/google/flax), including training scripts.
|
|
|
|
| 9 |
- text: "Fui a la librería a comprar un <mask>."
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# NOTE: This repository is now superseded by https://huggingface.co/bertin-project/bertin-roberta-base-spanish. This model corresponds to the `beta` version of the model using stepwise over sampling trained for 200k steps with 128 sequence lengths. Version 1 is now available and should be used instead.
|
| 13 |
+
|
| 14 |
# BERTIN
|
| 15 |
|
| 16 |
BERTIN is a series of BERT-based models for Spanish. This one is a RoBERTa-large model trained from scratch on the Spanish portion of mC4 using [Flax](https://github.com/google/flax), including training scripts.
|