---
language: is
thumbnail: https://mideind.is/pro_greynir_logo.2bce8b4e1ce0bbe535c5.svg
widget:
- text: Má bjóða þér <mask> í kvöld?
- text: Forseti <mask> er ágæt.
- text: Súpan var <mask> á bragðið.
tags:
- roberta
- icelandic
- masked-lm
- pytorch
license: agpl-3.0
---

# IceBERT

IceBERT was trained with fairseq using the RoBERTa model on the Icelandic Giga Word corpus.

This model will soon be replaced with another version trained on a larged dataset, this model will then be renamed to IceBERT-IGC