gguf
#4
by
goodasdgood
- opened
can convert Phi-3.5-MoE to gguf
what need to be done for supporting ollama? I get error
ollama run hf.co/abetlen/Phi-3.5-vision-instruct-gguf:Q8_0
pulling manifest
Error: pull model manifest: 400: Repository is not GGUF or is not compatible with llama.cpp