Pretraining Time Cost?
#30
by
fov223
- opened
Do you mind sharing how many hours you spend on 512 TPUv5es to pretrain Gemma 2B model? Also how many for Gemma 7B on 4096 TPUv5es? Thx.
Do you mind sharing how many hours you spend on 512 TPUv5es to pretrain Gemma 2B model? Also how many for Gemma 7B on 4096 TPUv5es? Thx.