Qwen2.5-VL 7B (Qwen2.5-VL)
Parameters: 8.29B
Mixture of experts: no
Q4_K_M size: 5.62 GB
Q8_0 size: 9.6 GB
Minimum RAM for Q4: 8 GB
Default context length: 32K
Subtype: vlm
Vision encoder size: 1.26 GB
Release: 2025-01
Hugging Face: Qwen/Qwen2.5-VL-7B-Instruct
HF downloads: 9880718
HF likes: 1606
Model license: Apache-2.0 (commercial use: yes)
Notes: Qwen2.5-VL 7B vision-language model: chats about images. Q4_K_M ~4.4GB plus a ~1.26GB fp16 vision projector (mmproj), folded into the totals. Sizes from the ggml-org GGUF repo. Vision needs an mmproj-capable runtime; many mobile runtimes do not support it yet.