baselabs elephant-1 (MLX 8-bit)

8-bit MLX conversion of baselabs/elephant-1 for Apple Silicon (mlx_lm).

Origin and license

Original weights: https://huggingface.co/baselabs/elephant-1
License: mit — carried over from the upstream weights; if anything conflicts, the upstream repository's LICENSE prevails.
Conversion: 8-bit quantization for MLX only; no retraining, no architecture changes.

Usage

from mlx_lm import load, generate
model, tokenizer = load("sergolsub/mlx-elephant-1-8bit")
print(generate(model, tokenizer, prompt="...", max_tokens=256))

Files

*.safetensors — 8-bit weights (MLX layout)
config.json, tokenizer*, chat_template.jinja — standard transformers/MLX set
*_mlx.py / decision_config.json / joint_config.json — decision/joint-head inference glue (present when the model has a decision mode)

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for sergolsub/mlx-elephant-1-8bit

Base model

Qwen/Qwen3.5-9B-Base

Finetuned

Qwen/Qwen3.5-9B

Finetuned

baselabs/elephant-1

Finetuned

(2)

this model