Fine Tuning examples

#21
by skeenan947 - opened

The examples for running the model for generation are great, but it would be helpful to have an example for fine tuning these models. I've been unsuccessful in training so far.

Yes please, can someone share a guide to finetune the model with individual data?

Yes - we need an instruction model on how to set up the model on a local environment, then run it using our individual and confidential data. Presumably there is a way to query or use our own data with Falcon?

Technology Innovation Institute org

This blogpost from HuggingFace contains useful pointers regarding finetuning the model with PEFT and in lower precision.

FalconLLM changed discussion status to closed

Yes please, can someone share a guide to finetune the model with individual data?

Sign up or log in to comment