how to use h2oai/h2ogpt-4096-llama2-13b-chat transformer for custom use case.
#4
by
5urabhi1
- opened
On using the web client h2oai gpt(h2oai/h2ogpt-4096-llama2-13b-chat) I am getting the correct response however the same prompt is not working with the downloaded transformers (h2oai/h2ogpt-4096-llama2-13b-chat) for the same model. It worked for first 3-4 times then it started generating random text generation.
For Example:
Question:"How many employees are there in Department X"
Sql_answer:[('2'),]
I want the model to generate the answer in this format:
Expected answer:"There are 2 employees in Department X."