started to raise error
#1
by
Esin
- opened
this model was working last week but now I am receiving this error.
NameError: name 'autogptq_cuda_256' is not defined
Can you try:
pip3 uninstall -y auto-gptq
GITHUB_ACTIONS=true pip3 install auto-gptq
and let me know if that fixes it
still receiving the same error
Edit: it is working after installing the proper the wheel.
in my case:
!pip install https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.3.0/auto_gptq-0.3.0+cu117-cp310-cp310-linux_x86_64.whl
Thank you, just solved my problem!!!!
I used this one though:
auto_gptq-0.3.2+cu117-cp310-cp310-linux_x86_64.whl
To check all the releases:
https://github.com/PanQiWei/AutoGPTQ/releases