Question Answering and Sentence completion format

#13
by codegood - opened

Hello,

I'm trying to build a model where I'll be fine tuning this model using sentences to increase it's knowledge base and then training it on Question Answering pairs for better performance.

I've the following questions:

  1. Is Sentence completion an ideal way to improve knowledge base of the model?
  2. What is the format for question answering? I know see how to ask question, but want to know how to add the ground truth answer which I think will be after tag.

Thanks

Amazon Web Services org

Hi @codegood

Thanks for your interest!

  • Yep point 1 is a reasonable idea
  • The format is suggested as
    <|prompter|>YOUR QUESTION<|assistant|>YOUR ANSWER
    But theoretically you can use whatever format you like to fine tune the model. Hope this helps. Cheers!
yinsong1986 changed discussion status to closed

Sign up or log in to comment