stopping pblm

#1
by bdambrosio - opened

Hi! I love the open-orca models! Open-Orca-platy2-13 is my favorite 13B model by far. Thank you!
I'm having trouble getting Mistral-7B-OpenOrca to stop. I've tried the prompt shown in the model card, the llama-2 prompt I use with Mistral-7B, and others.
I'm running in Transformers in bfloat16.
Any ideas?
thanks

I have the same issue unfortunately. Otherwise, the model is really good.

OpenOrca org

We just pushed updates to tokenizer config which should resolve this. Please report if not.

bleysg changed discussion status to closed

Sign up or log in to comment