pipenetwork/NVIDIA-Nemotron-3-Ultra-550B-A55B-MLX-4bit
Text Generation • 549B • Updated • 120
MLX quants of NVIDIA Nemotron-3 for Apple Silicon: Ultra 550B (4/5/6/8-bit) and dense Nano-4B (4/8-bit), converted with mlx-lm.
Note Ultra 550B 4-bit (~288GB) - recommended, single 512GB M3 Ultra
Note Ultra 550B 8-bit (~584GB) - multi-Mac shard
Note Nano 4B 8-bit (~4GB) - near-lossless, 16GB+ Macs
Note Nano 4B 4-bit (~2GB) - smallest