omlx feedback is missing chat template.jinja, unable to chat

#1
by sqh11 - opened

Omlx feedback indicates a missing chat template.jinja file, which prevents dialogue.
After I manually downloaded the chat template.jinja file from "https://huggingface.co/yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1/tree/main", omlx could use the model normally.
But there will be problems with tool calls.
If the file is lost, it will affect the 8bit, 4bit, and f16 versions.

Oh I see, let me take a look on this. I might have overlooked on the jinja file. Thanks for pointing it out.

I just downloaded the model today and was getting the same error, I'm glad this community exists.

Omlx feedback indicates a missing chat template.jinja file, which prevents dialogue.
After I manually downloaded the chat template.jinja file from "https://huggingface.co/yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1/tree/main", omlx could use the model normally.
But there will be problems with tool calls.
If the file is lost, it will affect the 8bit, 4bit, and f16 versions.

How did you point your model to the chat template file?
edit: figured it out: just curl it into the model's dir in .omlx

Sign up or log in to comment