llava-1.6-gguf / README.md
cmp-nct's picture
Update README.md
9563b98 verified
|
raw
history blame
411 Bytes

Base PR: https://github.com/ggerganov/llama.cpp/pull/5267
Note: integration in llama.cpp is partial at this point - it uses llava-1.5 preprocessing

The mmproj files are the embedded ViT's that came with llava-1.6, I've not compared them but given the previous releases from the team I'd be surprised if the ViT has not been fine tuned this time. If that's the case, using another ViT can cause issues.