Nimbus Labs local coding models

Nimbus-2B GGUF

Text-only llama.cpp artifacts for Nimbus-2B. Q5_K_M is the quality-first local default; Q4_K_M is listed only where it actually exists.

Choose a Nimbus model

Model Best fit Transformers GGUF
Nimbus-2B Fast drafting and focused edits Nimbus-Labs/Nimbus-2B Nimbus-Labs/Nimbus-2B-GGUF
Nimbus-4B Balanced implementation and debugging Nimbus-Labs/Nimbus-4B Nimbus-Labs/Nimbus-4B-GGUF
Nimbus-9B v2.1 Deeper coding and reasoning Nimbus-Labs/Nimbus-9B-v2.1 Nimbus-Labs/Nimbus-9B-v2.1-GGUF

Nimbus family download footprint

The adjacent assets/nimbus-family-footprint.json contains the plotted values. Download size is not runtime memory: context cache and runtime buffers require additional capacity.

Downloads

File Role Bytes SHA-256
Nimbus-2B-BF16.gguf BF16 reference 3,775,708,544 (3.78 GB) 4c35e21bec421799ba27fccb4ed560a534b243076c05fefb386b95d9e140123a
Nimbus-2B-Q4_K_M.gguf Memory-first 1,274,396,032 (1.27 GB) 25aefd6d16c6af14c87028e3edc958069e8515eb179727e12ba5c4180c46f995
Nimbus-2B-Q5_K_M.gguf Quality-first default 1,411,120,512 (1.41 GB) 25d813bfe0d655dfa3629322b332a3edd4d56c5d3b5f72a1fd245786b6770d03

llama.cpp

Validated release runtime: llama.cpp b10007. Native thinking uses the supplied Qwen/Ornith chat template and DeepSeek-style reasoning parsing.

llama-server --model Nimbus-2B-Q5_K_M.gguf --ctx-size 65536 --n-gpu-layers all --reasoning-format deepseek

Evaluation

No public score is claimed in this card yet. Results will be added only after the exact released artifact, complete task set, and scorer outputs are bound to a release manifest.

Provenance and scope

  • Quantized from Nimbus-Labs/Nimbus-2B
  • Foundation: Qwen3.5
  • GGUF files are text-only; the Transformers repository retains the multimodal components.
  • Do not infer memory fit from file size alone; context KV cache and runtime buffers require additional memory.

Licenses and notices

See LICENSES.md, THIRD_PARTY_NOTICES.md, and LICENSES/Apache-2.0.txt.

Project

Nimbus8Transformers checkpoint

Downloads last month
64
Safetensors
Model size
0.4B params
Tensor type
F16
U32
BF16
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Nimbus8-Labs/Nimbus-2B-MLX-4bit

Quantized
(2)
this model