BigBang-v1-MLX-2bit

MLX 2bit (affine, group size 32) quantized variant of endless-frontier/BigBang-v1 (text tower quantized; vision tower and projector retained in BF16) for Apple silicon via mlx-lm.

Provenance

  • Source: endless-frontier/BigBang-v1 @ revision fe313c9057ca2c51a07c7cf141915dc8cc3f620e (Apache-2.0 (upstream LICENSE)).
  • Quantized with mlx_lm.convert (mlx-lm 0.31.3): affine, 2-bit, group size 32.

Smoke gate

Before upload this pack passed a deterministic coherence gate: greedy 48-token chat generation loaded through mlx_lm.load, judged for emptiness, repetition loops, multi-script gibberish, and special-token debris. Verdict: ok.

Usage

pip install mlx-lm
mlx_lm.generate --model majentik/BigBang-v1-MLX-2bit --prompt "Hello"

Available tiers

Downloads last month
-
Safetensors
Model size
5B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

2-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for majentik/BigBang-v1-MLX-2bit

Quantized
(27)
this model