Gemma 4 12B MLX Model Fails to Load: gemma4_unified Not Supported
#2
by rishi454 - opened
The model downloads successfully (~12.7 GB), but fails during model initialization with:
ModuleNotFoundError: No module named 'mlx_lm.models.gemma4_unified'
ValueError: Model type gemma4_unified not supported.
Command used :
python3 -m mlx_lm server
--model "mlx-community/gemma-4-12B-it-8bit"
The same error occurs with both mlx-community/gemma-4-12B-it-bf16 and mlx-community/gemma-4-12B-it-8bit