training time

#4
by beginnerAI - opened

hello,

i want to train this model for other languages.
may i ask the training time and your computer? i would like to know how long does it take if i train it in NVIDIA A100 or 4090 etc.

thanks in advance.
seb

Thanks for your interest.

We used TPU v3-8 to train our model and it took about 40 and 84 hours for phase 1 and phase 2 of the base model, respectively.
I don't know how long it will take in other cases because the environment I used is not common called JAX.

If necessary, I will share the code used to train the model through GitHub.

hyunwoo3235 changed discussion status to closed

Sign up or log in to comment