Model card error

There’s an error in the yaml metadata in this model card. If you’re the model author, please log in to check the list of errors and warnings.

Catalan BERTa (RoBERTa-base) finetuned for Textual Entailment.

The roberta-base-ca-cased-te is a Textual Entailment (TE) model for the Catalan language fine-tuned from the BERTa model, a RoBERTa base model pre-trained on a medium-size corpus collected from publicly available corpora and crawlers (check the BERTa model card for more details).


We used the TE dataset in Catalan called TECA for training and evaluation.

Evaluation and results

We evaluated the roberta-base-ca-cased-te on the TECA test set against standard multilingual and monolingual baselines:

Model TECA (accuracy)
BERTa 79.12
mBERT 74.78
XLM-RoBERTa 75.44
WikiBERT-ca x

For more details, check the fine-tuning and evaluation scripts in the official GitHub repository.


If you use any of these resources (datasets or models) in your work, please cite our latest paper:

    title = "Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? {A} Comprehensive Assessment for {C}atalan",
    author = "Armengol-Estap{\'e}, Jordi  and
      Carrino, Casimiro Pio  and
      Rodriguez-Penagos, Carlos  and
      de Gibert Bonet, Ona  and
      Armentano-Oller, Carme  and
      Gonzalez-Agirre, Aitor  and
      Melero, Maite  and
      Villegas, Marta",
    booktitle = "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "",
    doi = "10.18653/v1/2021.findings-acl.437",
    pages = "4933--4946",
Downloads last month
Hosted inference API
Text Classification
Mask token: <mask>
This model can be loaded on the Inference API on-demand.
Evaluation results