Error FineTune with GPU 40GB !!!!!!!!!

#34
by developeranalyser - opened

i have 40GB gpu vram and id get error CUDA out of memory.
with A100 gpu

for fine tune how much gpu vram needed ?
id use colab pro its possible ?

Isn't it ridiculous?

TnkU

how can reduce qpu usage ?

Sign up or log in to comment