cuda extension not installed
#5
by
becks2000
- opened
I try to run the simple python script. It has this error.
I have installed cuda
Any ideas?
This happens if you haven't compiled AutoGPTQ:
git clone https://github.com/PanQiWei/AutoGPTQ
cd AutoGPTQ
pip install .
If you have run these steps and still get the error, it means that you can't compile the CUDA extension because you don't have CUDA toolkit installed. Install the toolkit and try again.
Hopefully fairly soon there will be pre-built binaries for AutoGPTQ and it won't be necessary to compile from source, but currently it is.
This comment has been hidden