qwen3.5-4B-super-coder MLX 4-bit

MLX 4-bit build of jica98/qwen3.5-4B-super-coder. The source repo only ships the LoRA adapter and GGUF exports, so this was built by:

  1. Loading unsloth/Qwen3.5-4B
  2. Merging the jica98/qwen3.5-4B-super-coder LoRA adapter with Qwen3_5ForConditionalGeneration
  3. Converting the merged Hugging Face model to MLX
  4. Quantizing to 4-bit with mlx-lm No additional training was done.

Use

pip install -U mlx-lm
mlx_lm.generate \
  --model snsnc/qwen3.5-4B-super-coder-MLX-4bit \
  --max-tokens 2048 \
  --temp 0.7 \
  --top-p 0.8 \
  --top-k 20 \
  --chat-template-config '{"enable_thinking":false}' \
  --prompt "Write only executable Python code. Implement an async token-bucket rate limiter."

Thinking is enabled by the upstream chat template unless explicitly disabled.
Downloads last month
102
Safetensors
Model size
0.7B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for snsnc/qwen3.5-4B-super-coder-MLX-4bit

Finetuned
Qwen/Qwen3.5-4B
Quantized
(1)
this model