Data-free VQ rungs of GLM-5.3-Flash for Apple Silicon. Three rungs, 2.7-3.6 bpw, MTP sidecars. Stock mlx-vlm. Built with VQLab.
Noah Zelezny
TheDrainFlorist
AI & ML interests
None yet
Recent Activity
updated a model about 12 hours ago
TheDrainFlorist/Qwen3.8-27B-VQ-4.8bpw updated a model about 12 hours ago
TheDrainFlorist/Qwen3.8-27B-VQ-3.9bpw updated a model about 12 hours ago
TheDrainFlorist/Qwen3.8-27B-VQ-4.5bpwOrganizations
None yet
Data-free VQ rungs of Qwen3.8-27B for Apple Silicon. Three rungs, 3.9-4.8 bpw, vision included. Stock mlx-lm. Built with VQLab.
Data-free VQ rungs of Qwen3.6-35B-A3B for Apple Silicon, from 32 GB Macs up. Four rungs, 3.4-5.4 bpw. Stock mlx-lm. Built with VQLab.
-
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-3.4bpw
Text Generation • 6B • Updated • 969 -
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-3.8bpw
Text Generation • 7B • Updated • 1.01k -
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-4.6bpw
Text Generation • 7B • Updated • 930 -
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-5.4bpw
Text Generation • 8B • Updated • 897
Data-free VQ rungs of Qwen3.8-Flash-Next for Apple Silicon. Four rungs, 2.1-5.5 bpw, MTP sidecar. Needs mlx-lm PR #1788. Built with VQLab.
-
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw
Text Generation • 25B • Updated • 2.13k • 3 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw
Text Generation • 43B • Updated • 1.49k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw
Text Generation • 90B • Updated • 1.58k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpw
Text Generation • 60B • Updated • 1.29k
Data-free VQ builds of gemma-4 for Apple Silicon: the 26B MoE and the e4b with VQ per-layer embeddings. Stock mlx-lm. Built with VQLab.
Data-free VQ rungs of Qwen3.5-397B-A17B for Apple Silicon, from one 128 GB Mac up. Four rungs, 2.2-3.1 bpw. Stock mlx-lm. Built with VQLab.
-
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.2bpw
Text Generation • 55B • Updated • 2.42k -
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.4bpw
Text Generation • 127B • Updated • 2.62k -
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.6bpw
Text Generation • 61B • Updated • 1.21k -
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-3.1bpw
Text Generation • 67B • Updated • 2.17k
Data-free VQ rungs of GLM-5.3-Flash for Apple Silicon. Three rungs, 2.7-3.6 bpw, MTP sidecars. Stock mlx-vlm. Built with VQLab.
Data-free VQ rungs of Qwen3.8-Flash-Next for Apple Silicon. Four rungs, 2.1-5.5 bpw, MTP sidecar. Needs mlx-lm PR #1788. Built with VQLab.
-
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw
Text Generation • 25B • Updated • 2.13k • 3 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw
Text Generation • 43B • Updated • 1.49k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw
Text Generation • 90B • Updated • 1.58k • 1 -
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpw
Text Generation • 60B • Updated • 1.29k
Data-free VQ rungs of Qwen3.8-27B for Apple Silicon. Three rungs, 3.9-4.8 bpw, vision included. Stock mlx-lm. Built with VQLab.
Data-free VQ builds of gemma-4 for Apple Silicon: the 26B MoE and the e4b with VQ per-layer embeddings. Stock mlx-lm. Built with VQLab.
Data-free VQ rungs of Qwen3.6-35B-A3B for Apple Silicon, from 32 GB Macs up. Four rungs, 3.4-5.4 bpw. Stock mlx-lm. Built with VQLab.
-
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-3.4bpw
Text Generation • 6B • Updated • 969 -
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-3.8bpw
Text Generation • 7B • Updated • 1.01k -
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-4.6bpw
Text Generation • 7B • Updated • 930 -
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-5.4bpw
Text Generation • 8B • Updated • 897
Data-free VQ rungs of Qwen3.5-397B-A17B for Apple Silicon, from one 128 GB Mac up. Four rungs, 2.2-3.1 bpw. Stock mlx-lm. Built with VQLab.
-
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.2bpw
Text Generation • 55B • Updated • 2.42k -
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.4bpw
Text Generation • 127B • Updated • 2.62k -
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.6bpw
Text Generation • 61B • Updated • 1.21k -
TheDrainFlorist/Qwen3.5-397B-A17B-VQ-3.1bpw
Text Generation • 67B • Updated • 2.17k