FERNET-C5

FERNET-C5 is a monolingual Czech BERT-base model pre-trained from 93GB of filtered Czech Common Crawl dataset (C5).

Preprint of our paper is available at https://arxiv.org/abs/2107.10042.

New

Select AutoNLP in the “Train” menu to fine-tune this model automatically.

Hosted inference API

Fill-Mask

Mask token: [MASK]

This model can be loaded on the Inference API on-demand.