Phi-3

#422
by MichelNivard - opened

Are you all sure the end of turn token for PHi-3 is set up correctly? I frequently get crazy run-away stuff, see screenshot, the last code chunk is gibberish and seems like it comes after what should have been an end of turn?

image.png

Hugging Chat org

Woops, could you share the conversation that got you this result if you're ok with that?

We've had some issues with the end tokens for Phi-3 but I thought I caught them all 😅

Sure here it is. When it initially failed with web search I figured that that might have not been implemnted smoothly yet, then I regenerated without search and it again tripped up.

https://huggingface.co/chat/conversation/L2_edoY

Sign up or log in to comment