Not working on an MAC M1
#1
by
alex-se
- opened
Hi,
Thank you for your work.
I tried to install it via Text Generation Web UI, but got this error:
ModuleNotFoundError: No module named 'awq'
How could I fix it?
macOS doesn't currently support AWQ or GPTQ models. Please download one of the GGUF models from the GGUF version of this model - GGUF works well on macOS.
Thank you! It works with GGUF, amazing work!