Still issues with tooling from time to time....

#29
by boldos - opened

Template v19 works pretty well, but I still do see issues with tooling occasionally πŸ˜₯
(Using ZED, running Qwen3.6-35b-a3b-Q4km in LM Studio with:
MoE = 12
thinking = off
temperature = 0.7
top_k = 20
repeat = off
presence = off
top_p = 0.95
min_p = 0.05
template = v19)
image

...and another example:
image

When thinking is disabled, smaller or quantized models like Q4_K_M frequently struggle to structure tool calls and tend to drop parameters. Try keeping thinking enabled. The new v20 template also adds fallback handling to help keep the context clean when this happens.

Ah, thanks for the info; I did not know this. You truly are awesome πŸ‘
Will try with Thinking too.

Nah; unfortunately I do not think that that is it... πŸ™
image

To add more context -> It seems that mostly it is actually "subagents" who do have issues with tooling, not the "main chat thread".
Do subagents actually inherit the same set of System prompt and Prompt template? πŸ€”

Sign up or log in to comment