GGUF

Buddy (v1 brain and eyes)

The on-device AI model used by Buddy: Your AI Friend, by Buddy's Burrow.

  • buddy-4b-Q4_K_M.gguf: Qwen3.5-4B, Q4_K_M quantization prepared by Unsloth (unsloth/Qwen3.5-4B-GGUF), unchanged.
  • buddy-4b-eyes-BF16.gguf: Qwen3.5-4B vision component (mmproj, BF16), prepared by Unsloth, unchanged.

Based on Qwen3.5-4B by the Qwen team at Alibaba Cloud, licensed under the Apache License, Version 2.0 (https://www.apache.org/licenses/LICENSE-2.0).

Downloads last month
68
GGUF
Model size
0.3B params
Architecture
clip
Hardware compatibility
Log In to add your hardware

4-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for buddysburrow/buddy-4b

Finetuned
Qwen/Qwen3.5-4B
Quantized
(603)
this model