Spaces:
Paused
Paused
How can I limit the length of the bot's answers?
#131
by
mikwee
- opened
I see that the bot's max token limit is 1,512. Which is very fair, but the problem is that it sometimes cannot finish its answers. Is there some prompt I can use to make its answers fit the limit? Please tell me if this does not fit here. Thanks.
The best I could come up with is starting prompts with:
"In X words, ..." Where X is a small number... 20, 50, and 100 seem to work better than larger numbers like 200.
When using 200 or more, it doesn't seem to have a strong effect.
Another that seems to work OK is starting the prompt with:
"In one sentence, ..."
But it can still just babble on without punctuation.
This AI has a rambling problem.