Text Generation
Transformers
GGUF
English
mistral
text-generation-inference

Is this the updated version with the EOS token fix?

#1
by Music4Dogs - opened

The original model had an issue where it wasn't generating EOS tokens sometimes, and from the upload times i think these quants got uploaded before the model was updated with a fix. I only ask because i saw an update but it appears to be an empty commit. (e860f1475dfc881da1dcfae3d1346a5afcd22a3e)

can confirm it doesn't stop, just keeps going

Sign up or log in to comment