Update README.md

README.md

@@ -13,10 +13,11 @@ This model card will contain more information *soon*. Please reach out to Alexan
 TBD
 
 ## Training data
-TBD
+2.5 billion tweets with 56 billion subwords in 66 languages (as identified in Twitter metadata). 
+The tweets are collected from the 1% public Twitter stream between January 2016 and December 2021.
 
 ## Training procedure
-TBD
+RoBERTa pre-training with BERT-base architecture.
 
 ## Evaluation results
 TBD