Update README.md

README.md

@@ -20,6 +20,12 @@ widget:
 
 # RoBERTa base trained with data from National Library of Spain (BNE)
 
+## Introduction
+This work presents the Spanish RoBERTa-base model. The model has been pre-trained using the largest Spanish corpus known to date, with a total of 570GB of clean and deduplicated text processed for this work, compiled from the web crawlings performed by the National Library of Spain from 2009 to 2019.
+
+## Evaluation
+For evaluation details visit our [GitHub repository](https://github.com/PlanTL-SANIDAD/lm-spanish).
+
 ## Citing 
 Check out our paper for all the details: https://arxiv.org/abs/2107.07253
 
@@ -34,4 +40,7 @@ Check out our paper for all the details: https://arxiv.org/abs/2107.07253
 }
 ```
 
-For more information visit our [GitHub repository](https://github.com/PlanTL-SANIDAD/lm-spanish)
+## Corpora
+| Corpora | Number of documents | Size (GB) |
+|---------|---------------------|-----------|
+| BNE     |         201,080,084 |     570GB |