Hugging Face's logo

Andrija
/
SRoBERTa-L

Fill-Mask
Transformers
PyTorch
Croatian
Serbian
multilingual
roberta
masked-lm
Inference Endpoints
Model card Files Community
2
Edit model card

Transformer language model for Croatian and Serbian

Trained on 6GB datasets that contain Croatian and Serbian language for two epochs (500k steps). Leipzig, OSCAR and srWac datasets

Model #params Arch. Training data
Andrija/SRoBERTa-L 80M Third Leipzig Corpus, OSCAR and srWac (6 GB of text)
Downloads last month
17
Fill-Mask
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Datasets used to train Andrija/SRoBERTa-L