fuse-1 Lite — MLX

MLX format of fuse-1 Lite for Apple Silicon.

Usage

from mlx_lm import load, generate

model, tokenizer = load("Akahsizrr/fuse-1-Lite-MLX", trust_remote_code=True)

prompt = tokenizer.apply_chat_template(
    [{"role": "user", "content": "Write a Python function to check if a number is prime."}],
    tokenize=False, add_generation_prompt=True,
)

response = generate(model, tokenizer, prompt=prompt, max_tokens=512)
print(response)
# CLI
mlx_lm.generate --model Akahsizrr/fuse-1-Lite-MLX --trust-remote-code --prompt "Write a Python fizzbuzz"

Requirements

  • Apple Silicon Mac (M1 or later)
  • pip install mlx-lm

See the main model card for full architecture details.

Downloads last month
-
Safetensors
Model size
6B params
Tensor type
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Akahsizrr/fuse-1-Lite-MLX

Finetuned
(1)
this model