PEFT
PyTorch
mixtral
generated_from_trainer

Thank you for this cool model. I tried to make a GGUF but encountered an error:

#1
by NikolayKozloff - opened

Traceback (most recent call last):
File "C:\fm\convert.py", line 1478, in
main()
File "C:\fm\convert.py", line 1464, in main
model = convert_model_names(model, params)
File "C:\fm\convert.py", line 1202, in convert_model_names
raise Exception(f"Unexpected tensor name: {name}")
Exception: Unexpected tensor name: model.layers.0.block_sparse_moe.gate.weight

Could you make a GGUF, please?

https://huggingface.co/Artefact2/shqiponja-15b-v1-GGUF

Wow, you're a genious! Thank you very much! Faleminderit, rrofshi sa malet!

NikolayKozloff changed discussion status to closed

Sign up or log in to comment