Base Mistral?

#1
by KatyTheCutie - opened

Judging from the description this is a LoRA for base Mistral? and not the instruct version? I don't think the base model can RP but please correct me if I'm wrong, also if possible could you merge this with the intended model and upload as a GGUF or LoRA applied model? Thank you. Hopefully that made sense as English is not my first language. πŸ˜…

Would also be cool is the Adastra one was also done like this perhaps, if possible? Thanks for your work a lot!

Owner

Yes, I used the plain Mistral model as a base for this LoRA and the Adastra IA3. I did this so people could (at least theoretically) apply this to any finetuned model based on mistral. I'd rather not post GGUFs and full models to avoid cluttering the site, since I doubt these will be frequently used. However, I'll try posting conversion scripts in the model card. And, in the meantime, you could try https://huggingface.co/spaces/Weyaxi/merge-lora to merge the model

KatyTheCutie changed discussion status to closed

Sign up or log in to comment