gguf

#4
by goodasdgood - opened

can convert Phi-3.5-MoE to gguf

what need to be done for supporting ollama? I get error

ollama run hf.co/abetlen/Phi-3.5-vision-instruct-gguf:Q8_0
pulling manifest
Error: pull model manifest: 400: Repository is not GGUF or is not compatible with llama.cpp

Sign up or log in to comment