system requierment
#2
by
mansoorhamidzadeh
- opened
hi
your model is perfect , very good
there is question , if we want run the model on local system , what we need?
I mean which cpu we need , which gpu ,.....
thank you
hi
thank you
you can load it on cpu but it will be so slow but i load it in fp16 on the 3090 GPU with 24G vram.
i think 16G ram and one GPU with at least 20G vram are enough.
also you can run quantized model on core i5 cou and 16G ram without GPU but with lower performance in model resonse