BERTIN
BERTIN is a series of BERT-based models for Spanish. This one is a RoBERTa-large model trained from scratch on the Spanish portion of mC4 using Flax, including training scripts.
This is part of the Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.
Team members
- Javier de la Rosa (versae)
- Manu Romero (mrm8488)
- María Grandury (mariagrandury)
- Ari Polakov (aripo99)
- Pablogps
- daveni
- Sri Lakshmi