LLm Studio and Ollama not working.

#1
by Ekolawole - opened

GGUF not working for this model on llm Studio and Ollama. So can't run the model

@Ekolawole thk, I am very sorry for my mistake (clumsiness).
I am updating all the files and it is now correct in terms of q4_0 quantization.

iShot_2024-05-13_16.12.08.png

q8 still not updated?

Owner

@alias8797 it has been updated just now.

Sign up or log in to comment