OneJev1.5 9B (MLX 8-bit)

8-bit MLX conversion of OmniJev/OneJev1.5-9B for Apple Silicon (mlx_lm).

Origin and license

Original weights: https://huggingface.co/OmniJev/OneJev1.5-9B
License: apache-2.0 — carried over from the upstream weights; if anything conflicts, the upstream repository's LICENSE prevails.
Conversion: 8-bit quantization for MLX only; no retraining, no architecture changes.

Usage

from mlx_lm import load, generate
model, tokenizer = load("sergolsub/mlx-onejev1.5-9b-8bit")
print(generate(model, tokenizer, prompt="...", max_tokens=256))

Files

*.safetensors — 8-bit weights (MLX layout)
config.json, tokenizer*, chat_template.jinja — standard transformers/MLX set
*_mlx.py / decision_config.json / joint_config.json — decision/joint-head inference glue (present when the model has a decision mode)

Downloads last month: -

Safetensors

Model size

9B params

Tensor type

BF16

U32

MLX

Hardware compatibility

Quantized

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for sergolsub/mlx-onejev_1_5_9B

Base model

Qwen/Qwen3.5-9B-Base

Finetuned

Qwen/Qwen3.5-9B

Finetuned

OmniJev/OneJev1.5-9B

Finetuned

(2)

this model