---
language: "cs"
tags:
- Czech
- KKY
- FAV
license: "cc-by-nc-sa-4.0"
---

# FERNET-News
FERNET-News is a monolingual Czech RoBERTa-base model pre-trained from 20.5GB of thoroughly cleaned Czech news corpus.

Preprint of our paper is available at https://arxiv.org/abs/2107.10042.