"Run them in LM Studio?"
#1
by
CloudMarked
- opened
This model cannot be run with Ollama?
Of course! Though you'd need to do some quirky stuff to get ollama to recognize it that I'm unaware of, or someone would need to upload them to the ollama library
What about the multi-part versions? Does one need to recombine them into a single gguf for use? If so, how?
Thanks.
You do not need to (at least for most tools, ollama is a funny one so I can't guarantee)
But for most tools you just point it at the first part and it'll look in the same folder for the second file and load it automatically
If you were to need to, you need to use the llama-split tool