YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
This project pretrains a roberta-base on the Alemannic (als) data subset of the OSCAR corpus in JAX/Flax.
We will be using the masked-language modeling loss for pretraining.
- Downloads last month
- 9