Hugging Face's logo

amazon
/
MistralLite

Text Generation
Transformers
PyTorch
mistral
text-generation-inference
Model card Files Community
20

Question Answering and Sentence completion format

#13
by codegood - opened
Discussion
codegood

Hello,

I'm trying to build a model where I'll be fine tuning this model using sentences to increase it's knowledge base and then training it on Question Answering pairs for better performance.

I've the following questions:

  1. Is Sentence completion an ideal way to improve knowledge base of the model?
  2. What is the format for question answering? I know see how to ask question, but want to know how to add the ground truth answer which I think will be after tag.

Thanks

yinsong1986
 Amazon Web Services org

Hi @codegood

Thanks for your interest!

  • Yep point 1 is a reasonable idea
  • The format is suggested as
    <|prompter|>YOUR QUESTION<|assistant|>YOUR ANSWER
    But theoretically you can use whatever format you like to fine tune the model. Hope this helps. Cheers!
yinsong1986 changed discussion status to closed

Sign up or log in to comment