Train to GPT-2 with own data

#73
by JeisonJA - opened

I would like to train gpt-2 with my documents to be able to ask questions about this information, what format should I give to my dataset?

OpenAI community org

Hi @JeisonJA
Thanks for your interest!
You might be interested in using SFTTrainer from TRL library: https://huggingface.co/docs/trl/sft_trainer let me know if you have any question

Sign up or log in to comment