This is a quant of Qwen3.5-122B-A10B with MTP support and using bartowski's dataset for the imatrix.

This was built from a modified llama.cpp to add support for MTP in llama-imatrix, see https://github.com/ggml-org/llama.cpp/pull/23258 https://github.com/ggml-org/llama.cpp/pull/23575

Downloads last month
314
GGUF
Model size
51.9M params
Architecture
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for wimmmm/Qwen3.5-122B-A10B-GGUF-MTP

Quantized
(177)
this model