arabic-t5-small / README.md
salti's picture
Create README.md
a5ace5e
|
raw
history blame
416 Bytes
metadata
language:
  - ar
datasets:
  - mc4
  - oscar
  - arabic_billion_words

arabic-t5-small

Training parameters

steps 22'000
Training batch size 384
Evaluation batch size 768
learning rate 1e-2
dtype jnp.float32