"Error while parsing tool calls, please retry"

#563
by Ezriel - opened

I keep getting "Error while parsing tool calls, please retry" which marks the response as "Retry" only, meaning I can't write a reply, only "retry", even though it's a perfectly valid response and I do not use tools. Sometimes this happens as often as on 90% of responses. This is extremely annoying, please fix.

I mostly use the newest "meta-llama/Meta-Llama-3.1-70B-Instruct" but it happened on 3.0 as well, and I think on other models as well.

image.png

image.png

Hugging Chat org

Could you share a conversation where this happens ?

I'll see if I can get a repro. It's not doing it right now. It might be related to "Model is overloaded".

Sign up or log in to comment