Changement by mlx_lm 0.0.10 update lead to an error using the load, generate call

#1
by BenBenser - opened
MLX Community org

Hello,

I recently ran into a typeError (raise TypeError(f'non-default argument {f.name!r} ' TypeError: non-default argument 'model_type' follows default argument
) after updating the package.

Since im pretty new to all this im not really sure if this error is caused by myself, but apparently it seems like the changed file "mixtral.py" in mlx_lm/models and its dataclass-decorated class "ModelArgs(BaseModelArgs):" ist causing the error by the misplaced attribute "model_type: str". After I positioned it before the optional attributes, it worked again.

MLX Community org

@BenBenser Good catch. Created PR here in the repository: https://github.com/ml-explore/mlx-examples/pull/450.

MLX Community org

Thanks! And thanks for creating PR repo, wasn't sure if I should create one.

Sign up or log in to comment