Does this model have gpu support?

#2
by Avos0001 - opened

i downloaded the Q4 k M version and opened it in gpt4all but it only uses Cpu and ram and it says model or quant has no gpu support.
is this problem on my end(like didnt download the drivers or some other missing requirement) or does this version really not have any gpu support at all
specs:
32 gb ddr5 ram
3090 24gb
i5-13600k
Windows 10 pro

Try the Q4_0 instead. I am on a 4090 24GB and it works.

Sign up or log in to comment