dumitrescustefan commited on
Commit
c3212a4
1 Parent(s): 43e4430

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -9,7 +9,7 @@ This is a pretrained-from-scratch [t5x](https://github.com/google-research/t5x)
9
 
10
  Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder and decoder sequence length of 512.
11
 
12
- #### **IMPORTANT** This model was pretrained on the span corruption LM task, meaning this model is **not usable** in any downstream task **without finetuning** first!
13
 
14
  ### How to load a t5x model
15
 
 
9
 
10
  Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder and decoder sequence length of 512.
11
 
12
+ **!! IMPORTANT !!** This model was pretrained on the span corruption MLM task, meaning this model is **not usable** in any downstream task **without finetuning** first!
13
 
14
  ### How to load a t5x model
15