Not surrounding function_call with <tool_call> tags.

#5
by markov-aug - opened

Whatever I do the answer is just the arguments, not surrounded by tool_call tags, so that the function call is not parsed.

NousResearch org

Whatever I do the answer is just the arguments, not surrounded by tool_call tags, so that the function call is not parsed.

Try now I removed those as being special tokens.

Or in your inference, use decode(generated_chat[0], skip_special_tokens=False, clean_up_tokenization_space=False)

GGUF version from you guys also has this issue

edit: apparently its in the works
image.png

NousResearch org

GGUF version from you guys also has this issue

edit: apparently its in the works
image.png

Its already updated now, try again.

teknium changed discussion status to closed

Sign up or log in to comment