Update README.md

README.md

@@ -1,6 +1,5 @@
 ---
 language: is
-thumbnail: https://mideind.is/pro_greynir_logo.2bce8b4e1ce0bbe535c5.svg
 widget:
 - text: Má bjóða þér <mask> í kvöld?
 - text: Forseti <mask> er ágæt.
@@ -13,8 +12,39 @@ tags:
 license: agpl-3.0
 ---
 
-# IceBERT
+# IceBERT-igc
 
-IceBERT was trained with fairseq using the RoBERTa model on the Icelandic Giga Word corpus.
+This model was trained with fairseq using the RoBERTa-base architecture. It is one of many models we have trained for Icelandic, see the paper referenced below for further details. The training data used is shown in the table below.
+
+| Dataset                                              | Size    | Tokens |
+|------------------------------------------------------|---------|--------|
+| Icelandic Gigaword Corpus v20.05 (IGC)               | 8.2 GB  | 1,388M |
+
+
+## Scitation
+
+The model is described in this paper [https://arxiv.org/abs/2201.05601](https://arxiv.org/abs/2201.05601). Please cite the paper if you make use of the model.
+
+```
+@article{DBLP:journals/corr/abs-2201-05601,
+  author    = {V{\'{e}}steinn Sn{\ae}bjarnarson and
+               Haukur Barri S{\'{\i}}monarson and
+               P{\'{e}}tur Orri Ragnarsson and
+               Svanhv{\'{\i}}t Lilja Ing{\'{o}}lfsd{\'{o}}ttir and
+               Haukur P{\'{a}}ll J{\'{o}}nsson and
+               Vilhj{\'{a}}lmur {\TH}orsteinsson and
+               Hafsteinn Einarsson},
+  title     = {A Warm Start and a Clean Crawled Corpus - {A} Recipe for Good Language
+               Models},
+  journal   = {CoRR},
+  volume    = {abs/2201.05601},
+  year      = {2022},
+  url       = {https://arxiv.org/abs/2201.05601},
+  eprinttype = {arXiv},
+  eprint    = {2201.05601},
+  timestamp = {Thu, 20 Jan 2022 14:21:35 +0100},
+  biburl    = {https://dblp.org/rec/journals/corr/abs-2201-05601.bib},
+  bibsource = {dblp computer science bibliography, https://dblp.org}
+}
+```
 
-This model will soon be replaced with another version trained on a larged dataset, this model will then be renamed to IceBERT-IGC