Instructions to use froggeric/Qwen-Fixed-Chat-Templates with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use froggeric/Qwen-Fixed-Chat-Templates with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen-Fixed-Chat-Templates froggeric/Qwen-Fixed-Chat-Templates
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Response will sometimes show full thought process to Frigate, which will fail to create a GenAI Summary
Just started testing this chat template and my main use-case for LLMs is Frigate image analysis.
Adding "<|think_off|>" is only possible with Frigate's regular AI description but the system prompts for GenAI Review summaries are hard coded in. IF it responds with full thought process for a GenAI Review summary, it will fail to work at all:
Timestamp
2026-05-21 07:50:04
Tag
frigate.genai
Message
Failed to parse review description as the response did not match expected format. 1 validation error for ReviewMetadata
Timestamp
2026-05-21 07:50:04
Tag
unknown
Message
Invalid JSON: trailing characters at line 8 column 1 [type=json_invalid, input_value='{\n "scene": "A person ...ial_threat_level": 0\n}', input_type=str]
For regular Frigate AI Descriptions, sometimes, it will respond with the full thought process:
The user wants a description of the dog(s) in the image. 1. **Identify the subject:** There is a small dog being walked on a leash. 2. **Analyze appearance:** * **Color:** Looks mostly white, possibly some light brown or tan patches (though hard to tell clearly due to blur). It looks like a small, fluffy dog. * **Size:** Small. It's significantly smaller than the person walking it. * **Breed:** Hard to be certain due to low resolution, but it resembles a small terrier mix, a Pomeranian, or perhaps a small spaniel mix. It looks fluffy and energetic. 3. **Analyze action/intent:** * **Action:** The dog is on a leash, being held by a person. It appears to be pulling or moving forward eagerly. Its legs are in motion, suggesting a trot or run. * **Intent:** It seems eager to move forward, perhaps excited about the walk or something ahead. It's actively engaging with the walk. 4. **Draft the description:** * Start with the dog's appearance: A small, fluffy dog, primarily white with possible light markings. * Mention breed potential: Resembles a small terrier or Pomeranian mix. * Describe action: It is on a leash, being walked by a person. * Describe intent: The dog appears energetic and eager, trotting or pulling slightly forward on the leash, seemingly excited to explore or continue the walk. 5. **Refine and condense (max 100 words):** * "A small, fluffy dog, likely a terrier or Pomeranian mix with white fur, is being walked on a leash. The dog appears energetic and eager, trotting forward with a purposeful stride while being held by its handler. Its body language suggests excitement and a desire to move ahead, possibly pulling slightly against the leash as it navigates the path. The animal is active and engaged in the walk." Let's check the word count and constraints. * No surroundings mentioned? Yes. * One paragraph? Yes. * Max 100 words? Let's count: ~70 words. Good. * No timestamps/watermarks? Yes. Final polish: "A small, fluffy dog, appearing to be a white terrier or Pomeranian mix, is being walked on a leash. The dog is energetic and eager, trotting forward with an active gait while being guided by a person. It seems intent on moving ahead, possibly pulling slightly on the lead as it explores or rushes along the path. The animal displays a lively demeanor, fully engaged in the activity of the walk." Wait, looking closer at the image, there might be *two* dogs? Or just one blurry dog? Let me re-examine. - Looking at the cluster near the leash handle... it looks like one small dog, maybe slightly blurry. Wait, looking really closely at the pixels near the white rectangle on the ground... it looks like one small dog, maybe white and grey/brown. - Actually, looking at the leash, it seems to be a single leash. The dog looks like a small, scruffy terrier type. - Let's stick to "a small dog" to be safe, or "small dogs" if I'm unsure. It looks like one dog. Let's assume one dog based on the single leash handle visible. - Re-evaluating the "white rectangle": That looks like a manhole cover or a patch on the sidewalk. The dog is near it. - The dog looks like a small, light-colored terrier mix. Revised description: "A small, light-colored dog, resembling a terrier or Pomeranian mix, is being walked on a leash. The dog appears energetic and eager, trotting forward with an active gait while being guided by a person. It seems intent on moving ahead, possibly pulling slightly on the lead as it rushes along. The animal displays a lively demeanor, fully engaged in the activity of the walk and moving purposefully alongside its handler." Word count: ~75 words. Perfect. Let's double check the "intent". The dog is moving forward. It looks like it's pulling a bit. Let's double check "appearance". Small, fluffy, light color (white/cream). Final check against constraints: - Examine dog(s): Yes. - What doing/intent: Walking, eager to move forward. - Appearance: Small, fluffy, light-colored, terrier/Pom mix. - No surroundings: Checked. - One paragraph: Checked. - Max 100 words: Checked. - No timestamps etc: Checked. One final look at the image. Is it possible there are two dogs? The leash looks like it might have two lines or just be tangled. The dog shape is a bit blobby. It looks like one small dog. I will describe it as a small dog. Actually, looking *very* closely at the blob near the white square... it looks like a small white dog. Maybe a bit of grey. Let's write the final response. "A small, fluffy dog, likely a terrier or Pomeranian mix with white and light brown fur, is being walked on a leash. The dog appears energetic and eager, trotting forward with a lively gait while being held by a person. It seems intent on moving ahead, possibly pulling slightly against the leash as it navigates the path. The animal displays an excited demeanor, fully engaged in the walk and rushing forward with purpose." Word count: 76 words. Good. Wait, is it a bike? The person is holding handlebars. Yes, it looks like a bicycle handle. The dog is running alongside or being pulled? No, the person is walking/riding slowly. The dog is on a leash attached to the bike or held by the person. The prompt asks about the dog. The dog is running/trotting. The intent is to move forward/excited. Final version: "A small, fluffy dog, appearing to be a white terrier or Pomeranian mix, is trotting eagerly on a leash. The dog seems highly energetic and intent on moving forward, possibly pulling slightly as it rushes alongside its handler. Its body language suggests excitement and a desire to explore or speed up the pace of the walk. The animal is active and engaged, displaying a lively demeanor as it navigates the path." This covers all bases. Wait, looking again, is it a dog? Yes, definitely a four-legged animal. Small. Is it possible it's a cat? Unlikely on a leash like that, looks like a dog gait. Is it possible there are two dogs? The leash looks a bit complex. But I see one main body. I'll stick with singular "dog". Final Polish: "A small, fluffy dog, likely a terrier or Pomeranian mix with white fur, is trotting eagerly on a leash. The dog appears energetic and intent on moving forward, possibly pulling slightly as it rushes alongside its handler. Its body language suggests excitement and a desire to explore or speed up the pace. The animal is active and engaged, displaying a lively demeanor as it navigates the path." </think> A small, fluffy dog, likely a terrier or Pomeranian mix with white fur, is trotting eagerly on a leash. The dog appears energetic and intent on moving forward, possibly pulling slightly as it rushes alongside its handler. Its body language suggests excitement and a desire to explore or speed up the pace. The animal is active and engaged, displaying a lively demeanor as it navigates the path.
Most other times, it responds correctly:
The dog is a small to medium-sized canine, appearing to be a mix with light brown or tan fur and darker markings, possibly a Jack Russell Terrier or similar terrier breed. It is actively running along the sidewalk, moving with purpose and speed. The dog's intent seems to be playfulness or chasing something, as it moves energetically across the pavement. Its body language suggests excitement and engagement with its environment, indicating a lively and spirited demeanor. The dog appears focused on its movement, possibly following a scent or object of interest.
If you need to hide the thought process for automated JSON parsers, you can set preserve_thinking to false in your template parameters, or prepend <|think_off|> in the prompt to bypass thinking. Alternatively, a non-reasoning base model like Qwen 2.5 Instruct is usually better suited for pure JSON summaries.