when tryy the code, AttributeError: type object 'QuantizedLinear' has no attribute 'quantize_module' report

#1
by cloudyu - opened

AttributeError: type object 'QuantizedLinear' has no attribute 'quantize_module'

I try mlx_lm from 0.7.0 to 0.9.0 the error is same.

/usr/bin/pip3 list | grep mlx
mlx 0.11.0
mlx-lm 0.9.0

MLX Community org

I don't have any issue

pip3 list | grep mlx
mlx 0.9.1
mlx-lm 0.7.0

MLX Community org

Update mlx_lm. it's been fixed.

cloudyu changed discussion status to closed

Sign up or log in to comment