Qwen2.5-VL 3B (Qwen2.5-VL)
Parameters: 3.75B
Mixture of experts: no
Q4_K_M size: 3.05 GB
Q8_0 size: 5.1 GB
Minimum RAM for Q4: 4 GB
Default context length: 32K
Subtype: vlm
Vision encoder size: 1.25 GB
Release: 2025-01
Hugging Face: Qwen/Qwen2.5-VL-3B-Instruct
HF downloads: 5514300
HF likes: 671
Model license: Apache-2.0 (commercial use: yes)
Notes: Qwen2.5-VL 3B vision-language model: chats about images. Q4_K_M ~1.8GB plus a ~1.25GB fp16 vision projector (mmproj), folded into the totals. Sizes from the ggml-org GGUF repo. Vision input needs an mmproj-capable runtime (llama.cpp, LM Studio); many mobile runtimes do not support it yet.