Error with bitsandbytes when using Flux NF4

#12
by creartivo - opened

I get the following error message: Error named Symbol not found at line 90 in file D:\a\bitsandbytes\bitsandbytes\csrc\ops.cu

This directory doesn't even exist because I only work on C:.

I use a Radeon RX 6700 XT graphics card and ComfyUI with Zluda. It actually runs smoothly with the other Flux models. It's just pretty slow. When I want to integrate the FLUX NF4 model, i always get the error message from above in this workflow. With another workflow I then get this error message: "Error occurred when executing UNETLoader:
"I don't know what to do anymore...

I having the same ERROR with my AMD graphics card : (
maybe we can wait for someone to fix the issue

Getting the same error here.
Using the newest version of lshqqytiger's stable-diffusion-webui-amdgpu-forge, Windows 11 and a 6950XT.
Normal Stable-diffusion gen works fine.

I'm getting the same error in Comfyui-Zluda win11 with an RX 6600. I too could run other Flux models, even though they were slow.

Same issue with Radeon RX 6700 XT graphics card, ComfyUI, running with Zluda. Has anyone found a workaround?

Now I'm not too knowledgable in this but as far as I can tell its a problem with bitsandbytes not supporting ZLUDA or AMD cards.
There is another branch one could try in the Github repo called "multi-backend-refactor" that is meant to support more than just NVIDIA cards but I don't have the technical know-how to do it.

Now I'm not too knowledgable in this but as far as I can tell its a problem with bitsandbytes not supporting ZLUDA or AMD cards.

Thats right. Zluda doesnt support bitsandbytes

Sign up or log in to comment