Having a hard time fine tuning with LoRA

#21
by abcampbell - opened

Spent 4 hrs and lots of conflicts btw transformers, sft and other pakcages the tuner needs, has anyone got a fine tuned version running?

I spent 5 hours trying to figure out today but I found this source and I think it works (we'll see I am running the script right now): https://ai.google.dev/gemma/docs/core/huggingface_text_finetune_qlora

Google org

Hi @abcampbell ,

Could you please check this link for fine-tuning details.

Thank you.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment