Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
conversational
custom_code
text-generation-inference

How to Finetune mpt-30b-chat?

#15
by nandakishorej8 - opened

I want ti fine tune this model on my custom data. Tried QLoRA but failed. As this model is not suppoter by PERT or LORA, I'm wondering how to finetune this model. Any example code will be really helpful

Sign up or log in to comment