Ling
Collection
2 items • Updated
How to use mlx-works/Ling-3.0-tiny-oQ4e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Ling-3.0-tiny-oQ4e mlx-works/Ling-3.0-tiny-oQ4e
This model was quantized using oQ (oMLX v0.6.0rc1) mixed-precision quantization.
4-bit