aimeri/spoomplesmaxx-gemma4-31B-mlx-5bit

This model was converted to MLX format from aimeri/spoomplesmaxx-gemma4-31B-1200 using mlx-vlm version 0.4.4. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm
python -m mlx_vlm.generate --model aimeri/spoomplesmaxx-gemma4-31B-mlx-5bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
Downloads last month
60
Safetensors
Model size
8B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for aimeri/spoomplesmaxx-gemma4-31B-1200-mlx-5bit

Quantized
(3)
this model

Datasets used to train aimeri/spoomplesmaxx-gemma4-31B-1200-mlx-5bit