Template breaks the model thinks about think tags
#73
by kelvie - opened
E.g. when trying to debug this template with itself, it often fails because it is thinking about the tag and I think it ends early.
This makes it impossible to e.g. debug or add think tag stripping to other tools,.
Or is this a llama.cpp problem?
This is cause by the model you used to debug this template. You cannot use the same model, or any model that uses any of the same tags. It is the same with any jinja template editing. You need to do it by hand and/or with a different model. For example, gemini models use different tags, therefore Antigravity works.
froggeric changed discussion status to closed