Prompt for conversation
#4
by
TungLam
- opened
I would like to use this model for a conversation like this
User: <chat something>
Assistant: <response something>
User: <chat something>
Assistant: <response something>
User: <chat something>
Assistant:
The model needs to receive the previous chat's context to remember the history. How should I write the prompt?
Thank you so much
Sorry for the delay in replying. Please refer to the following demo code.
https://huggingface.co/spaces/elyza/ELYZA-japanese-Llama-2-13b-instruct-demo/blob/demo/app.py
https://huggingface.co/spaces/elyza/ELYZA-japanese-Llama-2-13b-instruct-demo/blob/demo/model_vllm.py
In particular, here is the part that builds the prompt based on past history.
https://huggingface.co/spaces/elyza/ELYZA-japanese-Llama-2-13b-instruct-demo/blob/demo/model_vllm.py#L38-L48
Thank you so much for your reply.
TungLam
changed discussion status to
closed