What is the template used in bonito-v1?

#4
by pacozaa - opened

Hi! Awesome work on Bonito!

I converted bonito-v1 into GGUF(https://huggingface.co/pacozaa/bonito-gguf) and quantize it using llama.cpp, I would like to run the model using Ollama. Is there any template I should use?

Cheers!

Bats Research org
nihalnayak changed discussion status to closed

I know this discussion has been closed already, but can we add this snippet from the GitHub discussion / paper in the model description card? Thanks!

<|tasktype|>
Yes-no question answering
<|context|>
Zinedine Zidane -- After retiring as a player, Zidane
transitioned into coaching, becoming assistant coach at
Real Madrid… after the victory, he resigned as Real
Madrid coach.
<|task|>
Bats Research org

Thank you for the request. I will add the template to the model card description.

Sign up or log in to comment