Error triggered when using websearch with Falcon180B

#256
by mattjmattj - opened

Using WebSearch with Falcon 180B causes the following error:

Input validation error: `inputs` tokens + `max_new_tokens` must be <= 3000. Given: 957 `inputs` tokens and 2048 `max_new_tokens`

The same kind of error actually arises when the conversation is getting long, even when not using websearch

Hugging Chat org

I think it should be fixed now, I tweaked some settings. Let me know if it works better!

Good tweaking, then. No more error for me :)

mattjmattj changed discussion status to closed

Sign up or log in to comment