Tool Calling and Tags and Context awareness.

#28
by JanjanJean - opened

It seems this Version of Gemma is not aware it invoked a Tool I tested it in my Costum wrapper where everything is exposed for testing new AI and it's awareness.

For example i ask it to use Tool Call search for latest news, the it uses tool call the results come in but the downside it ignores the results that came in that literally has the Tag and notification it just invoked the Tool

Now I tested e2b and e4b and 26B and 31B they both are aware of the costum tool or prompt it seems this one has only one slight issue it's awareness or something and take note I used Q8_0 on all my test.

But still though minor issue for my use case no wonder alot are complaining about failure of Tool Usage in some UI or engines out there, the Model is not aware that the marked labeled results are the output of the tool or syntax it just used.

~Thanks google!

Google org

Hi @JanjanJean @TarekMahran
Thanks for reporting. Take a look at this: https://huggingface.co/google/gemma-4-12B-it/discussions/35. It updates the chat template to fix a bug where prior-turn reasoning and structural tags were being dropped or corrupted during multi-turn tool chains. Could you test it out for your scenario and let us know if it fixes the issue?

Sign up or log in to comment