NousResearch

/

Hermes-2-Pro-Llama-3-8B

like 372

Whatever I do the answer is just the arguments, not surrounded by tool_call tags, so that the function call is not parsed.

Try now I removed those as being special tokens.

Or in your inference, use decode(generated_chat[0], skip_special_tokens=False, clean_up_tokenization_space=False)

GGUF version from you guys also has this issue

edit: apparently its in the works

GGUF version from you guys also has this issue

edit: apparently its in the works

Its already updated now, try again.