prompt format?
#8
by
obtion
- opened
What is the prompt format for our model input? What is the truncation stop str? I'm having a problem with random answers when using VLLM acceleration.
Thanks a lot
A possible template for the prompt can be found here:
https://github.com/deepseek-ai/DeepSeek-Coder
I have been trying the traditional alpaca template and it worked fine.
Chester111
changed discussion status to
closed