This is a RoBERTa-base LM trained from scratch exclusively on Uruguayan press [1].
[1] huggingface.co/datasets/pln-udelar/uy22