Granite 4.0 H Small (Granite)
Parameters: 32B
Mixture of experts: yes
Active parameters (MoE): 9B
Q4_K_M size: 18.23 GB
Q8_0 size: 31.91 GB
Minimum RAM for Q4: 21 GB
Default context length: 128K
Release: 2025-10
Ollama tag: granite4:small-h
Ollama default download: 18.14 GB
Ollama pulls: 1.2M
Hugging Face: ibm-granite/granite-4.0-h-small
HF downloads: 328099
HF likes: 308
Model license: Apache-2.0 (commercial use: yes)
Notes: IBM Granite 4.0 H Small, hybrid Mamba/transformer MoE (32B total, 9B active), 128K context. Q4_K_M and Q8_0 sizes from the unsloth GGUF repo, matched to the Ollama granite4:small-h tag.