No MLX support of model type ouro - How to run?

by pculebras - opened 3 days ago

I was trying to run this model locally and mlx_lm keeps throwing the error: ValueError: Model type ouro not supported.

Is it safe to assume that it was quantized with MLX, but we have to wait for MLX to support the model type?

try upgrade the version you using..

MLX Community org 2 days ago

Hey! Support for this model was never merged , but there's a PR here: https://github.com/ml-explore/mlx-lm/pull/599

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment