Improved model card

README.md

@@ -9,7 +9,7 @@ datasets:
 metrics:
   - accuracy
 model-index:
-  - name: greek-longformer-base-4096-uncased
+  - name: greek-longformer-base-4096
     results:
       - task:
           name: Masked Language Modeling
@@ -27,14 +27,23 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# greek-longformer-base-4096-uncased
+# Greek Longformer
 
-This model is a Longformer model version based on [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) trained on the dataset/wiki_oscar_combined_normalized_uncased dataset from scratch.
+A Greek version of the Longformer Language Model.
+
+This model is a (from scratch) Greek Longformer model based on the configuration of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096), and trained on the combined datasets from the [Greek Wikipedia](https://huggingface.co/datasets/wikipedia) and the Greek part of [OSCAR](https://huggingface.co/datasets/oscar-corpus/OSCAR-2301).
 It achieves the following results on the evaluation set:
 
 - Loss: 1.1080
 - Accuracy: 0.7765
 
+## Pre-training corpora
+
+The pre-training corpora of `greek-longformer-base-4096` include:
+
+- The Greek part of [Wikipedia](https://el.wikipedia.org/wiki/Βικιπαίδεια:Αντίγραφα_της_βάσης_δεδομένων),
+- The Greek part of [OSCAR](https://traces1.inria.fr/oscar/), a cleansed version of [Common Crawl](https://commoncrawl.org).
+
 ## Model description
 
 More information needed