rope_theta in config.json
#3
by
akashicmarga
- opened
The quantized model config has rope_theta param, which was throwing an error as it was not used in model args. Removing this parameter worked for generation. @reach-vb how did you quantised the model?
You are right, it was removed by @marcsun13 in https://huggingface.co/mlx-community/Mistral-7B-Instruct-v0.2-4-bit/discussions/4