Any plans for chat model?
#5
by
brekk
- opened
Seems like Instruct model has been finetuned with chat data but is not specialized for the chat.
Is there any plans for releasing llama-2-7b-32k-chat model like llama-2-7b-chat?
Thank you in advance.
Hi @brekk ,
thanks for your interest! You're right, the model is tuned for instructions, so it is not primarily a chat model. I would encourage you to try out the together API, and finetune the model for chat. You can check out the blogpost here: https://together.ai/blog/llama-2-7b-32k-instruct, there is also example code that explains how to build a dataset, finetune the model and test it;)