FERNET-News_sk

FERNET-News_sk is a monolingual Slovak RoBERTa-base model pre-trained from 4.5GB of thoroughly cleaned Slovak news corpus.

It is a Slovak version of our Czech FERNET-News model.

Preprint of our paper is available at https://arxiv.org/abs/2107.10042.