Please see our fork of llama.cpp for more detail to run MiniCPM-Llama3-V 2.5 with llama.cpp
ollama
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit