Qwen3.5-9B-Seven
#2973
by KannaChanDeus - opened
https://huggingface.co/nightmedia/Qwen3.5-9B-Seven-q8-hi-mlx
Would you consider quantizing this model? I find it very interesting and would love to try it locally. It seems especially well-suited for roleplay, but unfortunately only a Q8 MLX quantization is available. Thanks!
Yeah of course it is, give me a bit and I'll upload the source
-G