h2oai/h2ogpt-4096-llama2-13b-chat · how to use h2oai/h2ogpt-4096-llama2-13b-chat transformer for custom use case.

On using the web client h2oai gpt(h2oai/h2ogpt-4096-llama2-13b-chat) I am getting the correct response however the same prompt is not working with the downloaded transformers (h2oai/h2ogpt-4096-llama2-13b-chat) for the same model. It worked for first 3-4 times then it started generating random text generation.

For Example:

Question:"How many employees are there in Department X"

Sql_answer:[('2'),]

I want the model to generate the answer in this format:

Expected answer:"There are 2 employees in Department X."