Qwen2.5 3B (Qwen2.5)
Parameters: 3.09B
Mixture of experts: no
Q4_K_M size: 2.1 GB
Q8_0 size: 3.62 GB
Minimum RAM for Q4: 4 GB
Default context length: 128K
Release: 2024-09-19
Ollama tag: qwen2.5:3b
Ollama default download: 1.8 GB
Ollama pulls: 23.2M
Hugging Face: Qwen/Qwen2.5-3B-Instruct
HF downloads: 6305929
HF likes: 522
Model license: Qwen Research License (commercial use: no)
License note: Qwen Research License: non-commercial use only.
Notes: Mid-range Qwen2.5 dense model. 128K context window, good coding and math performance relative to size. Runs on most 8GB RAM devices at Q4.