DeepSeek-V2-Lite (DeepSeek-V2)
Parameters: 16B
Mixture of experts: yes
Active parameters (MoE): 2.4B
Q4_K_M size: 10.4 GB
Q8_0 size: 16.8 GB
Minimum RAM for Q4: 13 GB
Default context length: 32K
Release: 2024-05
Ollama tag: deepseek-v2:16b
Ollama default download: 8.29 GB
Ollama pulls: 537.3K
Hugging Face: deepseek-ai/DeepSeek-V2-Lite
HF downloads: 485200
HF likes: 180
Model license: DeepSeek License (commercial use: yes)
License note: DeepSeek Model License permits commercial use.
Notes: MoE: 16B total / 2.4B active (2 shared + 64 routed experts per layer, 6 activated per token). Released 2024-05-16. Q4_K_M=10.4GB, Q8_0=16.8GB from mradermacher HF GGUF repo (bartowski does not host this model). Ollama deepseek-v2:16b=8.9GB uses different quantization. Context 32K native. Despite 16B total params, inference speed is close to 2.4B dense models.