How to finetune the model?

#129
by akasranjan - opened

I am a newbie in LLM world, i have a use case to finetune the model to custom pdf and csv dataset. Any guidance on how to achieve the same? Thanks.

start with a small model first. a 7b model like llama or mistral or even tinyllama. there's many tutorials on fine-tuning these models, start with "finetune llama" on google and start from there.

Perhaps I will have that need in future. It will not working on a 8x7B model such the one in that current page where I answer to that post?

Sign up or log in to comment