--- language: "sk" tags: - Slovak - KKY - FAV license: "cc-by-nc-sa-4.0" --- # FERNET-News_sk FERNET-News_sk is a monolingual Slovak RoBERTa-base model pre-trained from 4.5GB of thoroughly cleaned Slovak news corpus. It is a Slovak version of our Czech [FERNET-News](https://huggingface.co/fav-kky/FERNET-News) model. Preprint of our paper is available at https://arxiv.org/abs/2107.10042.