is there a way to run this on Mac?
#20
by
pandoraSama
- opened
I have no idea how to run this model on Mac .I successfully installed gpt4all but no luck here YouTube have a lot of windows tutorial but .bat file is not working for Mac š this sounds stupid but my brain is dead with this kind of things so please help .
Actually I donāt think you can run it on a Mac. I canāt even make it run on Windows without an NVIDIA GPU.
you can run it in google colab for free. This guy explains how to run this model locally and provides google colab link: https://www.youtube.com/watch?v=F_pFH-AngoE
GPTQ is made for GPU, If you want to run cpu, try GGML