liuhaotian

/

llava-v1.6-34b

like 280

@brugoua
heres a gguf version that i found. its still early support
https://huggingface.co/cjpais/llava-v1.6-34B-gguf

GGUF models are here now: https://huggingface.co/cmp-nct/llava-1.6-gguf
You can use the cjpais GGUF for the LLM but not the mmproj files, those need a redownload from my page.
In addition see the readme, you currently need to manually apply the PR for llama.cpp to make this work, though it should get merged soon.

@cmp-nct Can you provide the link to mmproj files? Any instruction to use them along with the main lava gguf?