QLORA -> EXL2 Code
#1
by
anokas
- opened
Hi there,
Would you be willing to share the code you use to fine-tune this model? Would be interesting to see how you train the QLoRA and how you bake it into the original weights for EXL2 conversion.
I'm just quantizing the models themselves and am not the author. My current scripts are a bit simplistic and do not add into the README.md a pointer back to the original model, it just copies the file. You can find the original here:
https://huggingface.co/Norquinal/Mistral-7B-claude-chat