CUDA extension not installed.
#4
by
lakkeo
- opened
Getting the "CUDA extension not installed." message when trying to load TheBloke models, I tried everything I've been on this problem for 15 litteral hours.
I tested CUDA 122,121,118, installed 3 versions of bitsandbytes on windows, reinstalled torch in conda, pip, venv, tested different version combinaisons...
The weird this is, I get good inference perf and no "CUDA extension not installed." in ooba but i do get it everytime in Python using transformers.
Please what am I missing I getting desperate and the similar tickets online are either outdated or too recent and all over the place...