Qwen3.5-9B LoRA GGUF โ€” Android Code Style

Converted from antiableofnormies/qwen3.5-9b-lora-android-dev.

Usage with llama.cpp

# Download base model
# e.g. unsloth/Qwen3.5-9B-MTP-GGUF (the Q4_K_M variant)

# Run llama-server with LoRA
llama-server   -m Qwen3.5-9B-Q4_K_M.gguf   --lora qwen3.5-9b-lora-android-dev.gguf   --port 8080   -ngl 99

Training Details

See parent LoRA repo for training details.

Downloads last month
82
GGUF
Model size
29.1M params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support