microsoft

/

Phi-3-mini-4k-instruct

like 811

The finetune script here is a basic example to get started which does not include PEFT, but it will be easy to add it as the example shown here: https://github.com/huggingface/alignment-handbook/blob/70769f9e9ba41c7f08ba6c4ff3725441b68b7ca3/scripts/run_sft.py#L175

ok i plugged into my peft notebook and it works!

https://colab.research.google.com/drive/1YploMbpWzpkQVNZEX3CDgaUtk1CQCenX?usp=sharing

(did not adhere to prompt format yet etc.)

thank you for the amazing work and the swift response!!!