there is no sliding_window in params.json

#41
by Moses25 - opened

https://github.com/huggingface/transformers/blob/main/src/transformers/models/mixtral/convert_mixtral_weights_to_hf.py
it raise error ,there is no "sliding_window" in params.json
this model is from torrent realese?
how to solve it?

Mistral AI_ org
β€’
edited Dec 15, 2023
sliding_window = int(params["sliding_window"]) if params.get("sliding_window", None) is not None else None

Should fix it.

Sign up or log in to comment