ToPo-ToPo/Ornith-1.0-9B-mlx-8bit

MLX 8bit conversion of deepreinforce-ai/Ornith-1.0-9B for Apple Silicon (mlx-vlm).

Provenance (self-converted from official weights)

  • Source: deepreinforce-ai/Ornith-1.0-9B (license: mit)
  • Tool: mlx-vlm 0.6.3mlx_vlm.convert --hf-path deepreinforce-ai/Ornith-1.0-9B --mlx-path . -q --q-bits 8 --q-group-size 64
  • Effective: 8.864 bits/weight
  • Validation: reproduced geometrically exact CAD output in an agentic CAD+FEM pipeline (volumes match the reference mlx-community conversion).

Usage

from mlx_vlm import load, generate
model, processor = load("ToPo-ToPo/Ornith-1.0-9B-mlx-8bit")
Downloads last month
296
Safetensors
Model size
3B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ToPo-ToPo/Ornith-1.0-9B-mlx-8bit

Quantized
(41)
this model

Collection including ToPo-ToPo/Ornith-1.0-9B-mlx-8bit