Install and run this locally on mac
#7
by
dnawdjk
- opened
Hi, this project is amazing. Is it possible to install and run it locally on a mac? Any tutorials for it?
Thanks! For running LLMs locally I heard oobabooga (https://github.com/oobabooga/text-generation-webui) is good. Here's a youtube tutorial on how to run this model on oobabooga: https://www.youtube.com/watch?v=k-LUHw4Hb_w
I'm sure there are other tutorials on how to run LLMs locally using oobabooga too.
CLI: ollama run llama2-uncensored