Uploading GGUf files to Ollama.
#1
by
JL42
- opened
Uploading GGUf files to Ollama.
-Create a file named Modelfile and in it write where on the disk we have downloaded the *.gguf file
FROM n:\b\newmes-v6.Q4_K_M.gguf
-in the Windows terminal we issue the command (we name our model and give the path to the Modelifile file) and we have the model available in Ollama:
ollama create newmes-v6 -f n:\b\Modelfile
-list of available models is displayed with the command:
ollama list
-model run
ollama run newmes-v6