ChatML prompt format problems
#7
by
kalomaze
- opened
I posted another discussion page for a model similar to this that also uses the ChatML prompt format, highlighting the weaknesses of the design. I hope the choice to use it will be reconsidered in the future
https://huggingface.co/ehartford/dolphin-2.0-mistral-7b/discussions/3
Some temporary compatibility issues, which will be ironed out eventually, is not a good excuse to stick with old and inherently flawed formats.
ChatML is inherently better than alternatives, but it will take some time for the community and for all our toolkits and frameworks to support it properly.
Inherently better how, exactly?
hello