fuse-1 Lite — GGUF

GGUF format of fuse-1 Lite for llama.cpp.

⚠️ Important: Custom llama.cpp Required

This GGUF uses the custom fuse3 architecture. Stock llama.cpp cannot load it. You need a llama.cpp fork with Fuse3 support.

See the integration guide for instructions on building llama.cpp with Fuse3 support.

Files

  • fuse-1-Lite-f16.gguf — F16 (full precision)
  • fuse-1-Lite-q4_k_m.gguf — Q4_K_M (4-bit quantized, ~4GB)
  • fuse-1-Lite-q8_0.gguf — Q8_0 (8-bit quantized, ~7GB)

Usage (with custom llama.cpp)

./llama-cli -m fuse-1-Lite-f16.gguf -p "Write a Python function to check if a number is prime." -n 512 --temp 0.1

See the main model card for full architecture details.

Downloads last month
-
GGUF
Model size
6B params
Architecture
fuse3
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Akahsizrr/fuse-1-Lite-GGUF

Quantized
(3)
this model