Do you know anything about this error?

#2
by RedXeol - opened

hello sorry to bother you have some knowledge about a bug that now happens in oobabooga when updating it with bitsandbytes 0.39.0 now i cant use rtx 3090 gpu i thought it was windows installer so i download it again and do a clean install but the error still persists.

bin A:\LLMs_LOCAL\oobabooga_windows\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.dll
R:\LLMs_LOCAL\oobabooga_windows\installer_files\env\lib\site-packages\bitsandbytes\cextension.py:34: User Warning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiply, and GPU quantization are not available.
warn("The installed version of bitsandbytes was compiled without GPU support. "
function 'cadam32bit_grad_fp32' not found

RedXeol changed discussion title from help!!! to Do you know anything about this error?

Hmm sorry I'm not quite sure why you're getting that. The text-generation-webui installation should take care of that

Maybe ask on the text-generation-webui Reddit page or Discord? I'm afraid I've never seen that error before

Thank you very much for your answer, I found the problem is an incompatibility of the xformers library that uses pytorch 2.0.1 and is still not compatible with the ui interfaces... solution, do not install it
Captura.PNG

Ahh thanks for letting me know!

It's working perfectly fine for me on Win 11, RTX4090 and bitsandbytes 0.39.0. @RedXeol : support for Falcon was just merged into main branch. Feel free to git pull ;)

Red try this tutorial. https://agi-sphere.com/text-generation-webui-windows It is highly specific to Windows and text-generation-webui
I nearly pulled my hair out trying to get past it. I got that error every try until I discovered the Windows pre-built wheels for Bits & Bytes.

Good luck!

Sign up or log in to comment