Question Answering and Sentence completion format
#13
by
codegood
- opened
Hello,
I'm trying to build a model where I'll be fine tuning this model using sentences to increase it's knowledge base and then training it on Question Answering pairs for better performance.
I've the following questions:
- Is Sentence completion an ideal way to improve knowledge base of the model?
- What is the format for question answering? I know see how to ask question, but want to know how to add the ground truth answer which I think will be after tag.
Thanks
Hi @codegood
Thanks for your interest!
- Yep point 1 is a reasonable idea
- The format is suggested as
<|prompter|>YOUR QUESTION<|assistant|>YOUR ANSWER
But theoretically you can use whatever format you like to fine tune the model. Hope this helps. Cheers!
yinsong1986
changed discussion status to
closed