Behaviour with AMD GPU offload?

#7
by thigger - opened

I appreciate that this has only been tested on Nvidia, but I have an AMD 7800XT and am getting really weird results with any GPU offload enabled. The text is barely related to the instruction and makes bizarre diversions. It works fine on CPU.

I'm using LM Studio on Windows. Is anyone else experiencing this or do you have any hints? Thanks

I have a amd rx7900xt gpu with rocm installed, yet its not even used. Although my integrated amd gpu is getting used. I've even tried putting the dedicated gpu as the main for the program with windows settings, gaming, display.

Lm Studio version - 0.2.16
Windows version - 11 23H2

Sign up or log in to comment