GitHub repository: Ermlab/PoLitBert
Description: Polish RoBERTA model trained on Polish Wikipedia, Polish literature and Oscar. Major assumption is that quality text will give good model.