yhavinga
/

ul2-large-dutch

Text2Text Generation Transformers PyTorch JAX TensorBoard

Dutch t5 dutch t5x ul2 seq2seq text-generation-inference

Model card Files Files and versions Metrics Training metrics Community

yhavinga commited on May 17, 2023

Commit

073e227

•

1 Parent(s): 043ba5a

Autoupdate README.md

Files changed (1) hide show

README.md +1 -4

README.md CHANGED Viewed

@@ -115,10 +115,7 @@ Therefore, the model can have biased predictions. This bias will also affect all
 The `ul2-large-dutch` T5 model was pre-trained simultaneously on a combination of several datasets,
 including the full version of the "mc4_nl_cleaned" dataset, which is a cleaned version of Common Crawl's web
 crawl corpus, Dutch books, the Dutch subset of Wikipedia (2022-03-20), and a subset of "mc4_nl_cleaned"
-containing only texts from Dutch and Belgian newspapers. This last dataset is oversampled to bias the model
-towards descriptions of events in the Netherlands and Belgium.
 ## Training procedure

 The `ul2-large-dutch` T5 model was pre-trained simultaneously on a combination of several datasets,
 including the full version of the "mc4_nl_cleaned" dataset, which is a cleaned version of Common Crawl's web
 crawl corpus, Dutch books, the Dutch subset of Wikipedia (2022-03-20), and a subset of "mc4_nl_cleaned"
+containing only texts from Dutch newspapers.
 ## Training procedure