Finetuning codeparrot model

#6
by mongoose54 - opened

Is there a step-by-step description available on finetuning huggingface codeparrot model on custom Python dataset?

Hi, CodeParrot is just like any decoder model from the class AutoModelForCausalLM, you can see this tutorial for fine-tuning pre-trained models https://huggingface.co/docs/transformers/training, we also have some examples for fine-tuning CodeParrot in here: https://github.com/huggingface/transformers/tree/main/examples/research_projects/codeparrot/examples

loubnabnl changed discussion status to closed

Sign up or log in to comment