Data-free VQ rungs of GLM-5.3-Flash for Apple Silicon. Three rungs, 2.7-3.6 bpw, MTP sidecars. Stock mlx-vlm. Built with VQLab.
Noah Zelezny
TheDrainFlorist
AI & ML interests
None yet
Recent Activity
updated a model about 1 hour ago
TheDrainFlorist/Qwen3.8-27B-VQ-4.8bpw updated a model about 1 hour ago
TheDrainFlorist/Qwen3.8-27B-VQ-3.9bpw updated a model about 1 hour ago
TheDrainFlorist/Qwen3.8-27B-VQ-4.5bpwOrganizations
None yet
Qwen3.8-Flash-Next — Vector Quantized (MLX)
Data-free VQ rungs of Qwen3.8-Flash-Next for Apple Silicon. Four rungs, 2.1-5.5 bpw, MTP sidecar. Needs mlx-lm PR #1788. Built with VQLab.
-
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw
Text Generation • 25B • Updated • 1.92k • 3 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw
Text Generation • 43B • Updated • 1.25k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw
Text Generation • 90B • Updated • 1.27k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpw
Text Generation • 60B • Updated • 1.15k
GLM-5.3-Flash-VQ — Vector Quantized (MLX)
Data-free VQ rungs of GLM-5.3-Flash for Apple Silicon. Three rungs, 2.7-3.6 bpw, MTP sidecars. Stock mlx-vlm. Built with VQLab.
Qwen3.8-Flash-Next — Vector Quantized (MLX)
Data-free VQ rungs of Qwen3.8-Flash-Next for Apple Silicon. Four rungs, 2.1-5.5 bpw, MTP sidecar. Needs mlx-lm PR #1788. Built with VQLab.
-
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw
Text Generation • 25B • Updated • 1.92k • 3 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw
Text Generation • 43B • Updated • 1.25k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw
Text Generation • 90B • Updated • 1.27k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpw
Text Generation • 60B • Updated • 1.15k
models 20
TheDrainFlorist/Qwen3.8-27B-VQ-4.8bpw
Text Generation • 13B • Updated • 1.21k
TheDrainFlorist/Qwen3.8-27B-VQ-3.9bpw
Text Generation • 12B • Updated • 1.25k
TheDrainFlorist/Qwen3.8-27B-VQ-4.5bpw
Text Generation • 19B • Updated • 1.43k • 1
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpw
Text Generation • 60B • Updated • 1.15k
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw
Text Generation • 90B • Updated • 1.27k • 1
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw
Text Generation • 43B • Updated • 1.25k • 1
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw
Text Generation • 25B • Updated • 1.92k • 3
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-3.1bpw
Text Generation • 67B • Updated • 2.11k
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.6bpw
Text Generation • 61B • Updated • 1.17k
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.4bpw
Text Generation • 127B • Updated • 2.57k
datasets 0
None public yet