can anyone help me to get Prompt template for question answering model

#18
by Iamexperimenting - opened

Hi Team,

Currently, I'm working on building "Question answering model using opensource LLM". Currently, I'm using the below template to generate answering

"""
{context}\n\n{question}
"""

This template provides me one word answer.

Example
Question : what is the maximum kilometer did Andrew covered during his cycling practice?
Answer: 28 Kilometer

Is it possible to generate answers like conversational ai(human-like reply)
example
Question : what is the maximum kilometer did Andrew covered during his cycling practice?
Answer: Maximum kilometer covered by Andrew is 28.

can anyone please help me here?

Hi @Iamexperimenting
You may want to try out different sampling techniques first: https://huggingface.co/blog/how-to-generate and see if this helps
For generating better responses in general I would recommend to also try out different models such as mistral-7b: https://huggingface.co/mistralai/Mistral-7B-v0.1 or Llama-2

Sign up or log in to comment