Commit
•
a837cba
1
Parent(s):
dfbcd02
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ license: apache-2.0
|
|
| 6 |
|
| 7 |
# T5x-large-romanian
|
| 8 |
|
| 9 |
-
This is a pretrained-from-scratch [t5x](https://github.com/google-research/t5x)
|
| 10 |
|
| 11 |
Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder and decoder sequence length of 512.
|
| 12 |
|
|
|
|
| 6 |
|
| 7 |
# T5x-large-romanian
|
| 8 |
|
| 9 |
+
This is a pretrained-from-scratch T5v1.1 large model (783M parameters) on the [t5x](https://github.com/google-research/t5x) platform.
|
| 10 |
|
| 11 |
Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder and decoder sequence length of 512.
|
| 12 |
|