Nimbus-4B GGUF
Text-only llama.cpp artifacts for Nimbus-4B. Q5_K_M is the quality-first local default; Q4_K_M is listed only where it actually exists.
Choose a Nimbus model
| Model | Best fit | Transformers | GGUF |
|---|---|---|---|
| Nimbus-2B | Fast drafting and focused edits | Nimbus-Labs/Nimbus-2B |
Nimbus-Labs/Nimbus-2B-GGUF |
| Nimbus-4B | Balanced implementation and debugging | Nimbus-Labs/Nimbus-4B |
Nimbus-Labs/Nimbus-4B-GGUF |
| Nimbus-9B v2.1 | Deeper coding and reasoning | Nimbus-Labs/Nimbus-9B-v2.1 |
Nimbus-Labs/Nimbus-9B-v2.1-GGUF |
The adjacent assets/nimbus-family-footprint.json contains the plotted values. Download size is not runtime memory: context cache and runtime buffers require additional capacity.
Downloads
| File | Role | Bytes | SHA-256 |
|---|---|---|---|
Nimbus-4B-BF16.gguf |
BF16 reference | 8,424,392,960 (8.42 GB) | aec0fd8c767f67522ade75e453cdc9c2b8cbf16fdfa134cbbe6d20554f2cdb6b |
Nimbus-4B-Q4_K_M.gguf |
Memory-first | 2,708,803,840 (2.71 GB) | f404660f5fb11fba99112b02c02e215945b48a2b981c26d05f6d3afd2d30e474 |
Nimbus-4B-Q5_K_M.gguf |
Quality-first default | 3,074,986,240 (3.07 GB) | def18cfa32028c76f8976a8856139440c601b305e71da5d4a13f0104f6994e5f |
llama.cpp
Validated release runtime: llama.cpp b10007. Native thinking uses the supplied Qwen/Ornith chat template and DeepSeek-style reasoning parsing.
llama-server --model Nimbus-4B-Q5_K_M.gguf --ctx-size 65536 --n-gpu-layers all --reasoning-format deepseek
Evaluation
The released Q5_K_M artifact was evaluated in direct mode on the full HumanEval and MBPP suites with llama.cpp b10007, one answer per task, temperature 0.6, top-p 0.95, top-k 20, and seed 42.
| Benchmark | Passed | Total | pass@1 |
|---|---|---|---|
| HumanEval | 121 | 164 | 73.8% |
| HumanEval+ | 112 | 164 | 68.3% |
| MBPP | 285 | 378 | 75.4% |
| MBPP+ | 232 | 378 | 61.4% |
The adjacent assets/nimbus-4b-evalplus.json is the machine-readable source for this chart.
Provenance and scope
- Quantized from
Nimbus-Labs/Nimbus-4B - Foundation: Qwen3.5
- GGUF files are text-only; the Transformers repository retains the multimodal components.
- Do not infer memory fit from file size alone; context KV cache and runtime buffers require additional memory.
Licenses and notices
See LICENSES.md, THIRD_PARTY_NOTICES.md, and LICENSES/Apache-2.0.txt.
Project
- Downloads last month
- 23