Finetune roberta
Hi, Is there any codebase or guidance which I follow to finetune roberta on my own dataset?
Hi
@humza-sami
- I haven't published one but there should be some good ones online - try googling for AutoModelForSequenceClassification.from_pretrained problem_type=multi_label_classification
or similar (as that's the method I used to generate this one) and I think you'll find guides in Medium articles and notebooks in Github that should get you on the right track.
For example https://github.com/NielsRogge/Transformers-Tutorials/blob/master/BERT/Fine_tuning_BERT_(and_friends)_for_multi_label_text_classification.ipynb from @nielsr (which you could fork and modify to use Roberta and your own data)
Regards,
Sam.
Thanks @SamLowe , I am basically trying to finetuned it on three class problem. I will give it a shot as well