Implement length / context window size upper limits

#9
by Tonic - opened
Tonic AI org

basically if people use this they will break it , then we have to restart the whole thing and wait, unless we put an upper bound on the size of the inputs .

Hi @Tonic , is it possible to set a limit on the length of inputs? For instance, the input length could be restricted to <5000 characters. If the length exceeds this limit, the system could raise an error

Sign up or log in to comment