"Run them in LM Studio?"

#1
by CloudMarked - opened

This model cannot be run with Ollama?

Of course! Though you'd need to do some quirky stuff to get ollama to recognize it that I'm unaware of, or someone would need to upload them to the ollama library

What about the multi-part versions? Does one need to recombine them into a single gguf for use? If so, how?

Thanks.

You do not need to (at least for most tools, ollama is a funny one so I can't guarantee)

But for most tools you just point it at the first part and it'll look in the same folder for the second file and load it automatically

If you were to need to, you need to use the llama-split tool

1x1__Content__INSS_DE_OBRAS__about_D(2).png

Sign up or log in to comment