What system prompt are you using on the website?
#2
by
froggeric
- opened
No matter what system prompt I try, cannot get results as good as on the website. What system prompt should I be using to reproduce the same results locally?
I am using a FP16 conversion, with the inference settings and prompt format specified on the model card.
Hey! On the website we're serving v1.7: https://twitter.com/WhiteRabbitNeos/status/1767958717356736894
It is an improved model, and is closed-weights for now.
migtissera
changed discussion status to
closed