w4a8 without dynamic vram support
#7
by inykokso - opened
so i tested this on 5060ti 16gb , works ok if it fit on gpu (model+latent) , if it doesnt then oom...
max i was able to do 864x480 10s , 13s if i close all other app
int 8 is way slower as it not fit to 16gb , but creating longer or/and higher res is posible
solved , updated cuda from cu128 to cu130 , and disabled 2nd gpu