GGUF conversion assistance?

#3
by FiditeNemini - opened

Hiya. I've been trying to port this and dolphin-vision to GGUF and am having a bit of a block. I'm running into an error NotImplementedError: Architecture 'BunnyQwenForCausalLM' not supported! I think I know where to add it in the llama.cpp code, but don't have the right parameters to set. Could you perhaps give me a pointer or two?

@FiditeNemini The creator, @qnguyen3 , is working on it I think.

Sign up or log in to comment