TheBloke

/

WestLake-7B-v2-AWQ

like 4

According to the original model community questions, the max context length of the model is 8k and it uses chatML as the template format.
I drop the link here as reference. Have a good day!

• https://huggingface.co/senseable/WestLake-7B-v2/discussions/1
• https://huggingface.co/senseable/WestLake-7B-v2/discussions/5