How to Calculate GPU usage for re-training Microsoft/speechT5_tts ?

#27
by huggingfacerohit - opened

I need a Mathematic formula to calculate how much GPU i need to re-train the model

accelerate org

It should be the same as Training using Adam (Peak vRAM), plus some wiggle room, unless you're doing something like LoRA

Sign up or log in to comment