Awesome Apple M1 Pro 32Gb local LLMs collection
Collection
Hardware: Apple Macbook Pro 14', M1 Pro chip 32Gb 14GPU. Clients: VS Code + Continue + Zoo Code (ex. Roo Code). Local LLM provider: oMLX. • 16 items • Updated • 1
How to use ilukashin/Qwen3-Coder-30B-A3B-Instruct-oQ3.5-fp16 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen3-Coder-30B-A3B-Instruct-oQ3.5-fp16 ilukashin/Qwen3-Coder-30B-A3B-Instruct-oQ3.5-fp16
This model was quantized using oQ (oMLX v0.3.9) mixed-precision quantization.
3-bit