My experimental IQ4_XS small size quants for Qwen3.6-27B so I can squeeze them into 16GB VRAM with relatively large context
k0valik
k0valik
AI & ML interests
None yet
Recent Activity
liked a model 1 day ago
mudler/parakeet-cpp-gguf new activity 2 days ago
k0valik/Darwin-28B-Coder-IQ4_XS12.9GiB-GGUF:tensor 'output.weight' has invalid ggml type 139Organizations
None yet