KAT-Coder
Collection
2 items • Updated
How to use jedisct1/KAT-Coder-V2.5-Dev-oQ4e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir KAT-Coder-V2.5-Dev-oQ4e jedisct1/KAT-Coder-V2.5-Dev-oQ4e
This model was quantized using oQ (oMLX v0.5.3) mixed-precision quantization.
4-bit