Hugging Face model: majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit
Author: majentik
Created: 2026-04-17 04:55:57
Last modified: 2026-07-20 16:41:10
Pipeline: text-generation
Library: mlx
Likes: 0 | Downloads: 423
Tags: mlx, safetensors, qwen3_5_moe, rotorquant, kv-cache-quantization, qwen, qwen-3.6, qwen3.6, moe, quantized, 4bit, text-generation, conversational, arxiv:2504.19874, base_model:Qwen/Qwen3.6-35B-A3B, base_model:quantized:Qwen/Qwen3.6-35B-A3B, license:apache-2.0, 5-bit, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3.6-35B-A3B
Card metadata:
base_model: Qwen/Qwen3.6-35B-A3B
library_name: mlx
tags: rotorquant, kv-cache-quantization, qwen, qwen-3.6, qwen3.6, moe, quantized, mlx, 4bit
license: apache-2.0
pipeline_tag: text-generation