what memory needed ?
#78
by
francescofiamingo
- opened
hi! i m facinng problem to use the model, with my gpu ge force rtx 4070 laptop, i have 8 giga memory dedicated and 8 giga shared of vram, but i go out of memory , i m doing something wrong? or simple i have not enough memory?
if i run the model with my cpu, it works but in hours.....
On Google Colab, using T4 it takes around 16Gb, and ~1-2 mins per prompt.