peft

#15
by wendlerc - opened

does this allow for peft yet?

Microsoft org

The finetune script here is a basic example to get started which does not include PEFT, but it will be easy to add it as the example shown here: https://github.com/huggingface/alignment-handbook/blob/70769f9e9ba41c7f08ba6c4ff3725441b68b7ca3/scripts/run_sft.py#L175

ok i plugged into my peft notebook and it works!

https://colab.research.google.com/drive/1YploMbpWzpkQVNZEX3CDgaUtk1CQCenX?usp=sharing

(did not adhere to prompt format yet etc.)

thank you for the amazing work and the swift response!!!

wendlerc changed discussion status to closed

Sign up or log in to comment