Text Generation
Transformers
Safetensors
mixtral
conversational
Inference Endpoints
text-generation-inference

Chatml format for Bagel

#4
by adam3245 - opened

I used Bagel with Chatml format on SillyTavern. It had a few problems, but with proper instruct prompt, they are easily fixable. With chatml format, I'll give it a 8.9/10.

The new bagel versions will have the actual chatml tokens, so it should work more seamlessly.

jondurbin changed discussion status to closed

Sign up or log in to comment