what tool format?
#2
by InformaticsSolutions - opened
Serving this model with tabbyapi. It works great except for tool calling. Tried all supported tool_format values, none works - gets stuck on tool calls, returns something like <|tool_call_start|>[search_files(pattern='README*', target='content', path='/home/user1/workspace', output_mode='files_only')]<|tool_call_end|>
Has anyone been able to get tool calls working? If yes, what tool_format did you use? Thanks!
turns out tabbyAPI doesn't support (yet) LFM2.5 tool call format. Also the model's chat_template.jinja is broken. Opened a PR to address this: https://github.com/theroyallab/tabbyAPI/pull/464.