Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Falcon 180B short responses
#252
by
Aspect004
- opened
Hi! I've just noticed that Falcon 180B-Chat was added to the HuggingChat models list, which is super awesome. But I am facing an issue with it which is that the responses are so short, I think that the token length needs to be increased. It has a low maximum token length per response.
The maximum token length is actually 2048 for Falcon 180B! I think it's just very concise. Feel free to set your system prompt to ask it to be a bit more verbose if you think it's not enough.
Hi @nsarrazin , I have a problem with the system prompts of Falcon 180B; it is very insensitive to the prompts I set; it simply ignores them and responds with the default style.