FERNET-C5

FERNET-C5 is a monolingual Czech BERT-base model pre-trained from 93GB of filtered Czech Common Crawl dataset (C5).

Preprint of our paper is available at https://arxiv.org/abs/2107.10042.

New

Select AutoNLP in the “Train” menu to fine-tune this model automatically.

Downloads last month
240
Hosted inference API
Fill-Mask
Mask token: [MASK]
This model can be loaded on the Inference API on-demand.