Max token discrepency

#8
by Junkemail7558 - opened

Title states "Demo limited to ctxlen 3000." but the token_count gr.Slider max is set to 333 (line 119 of app.py).

Is this intentional or a mistake? Am I mixing up token count and whatever ctxlen means?

Junkemail7558 changed discussion status to closed
Junkemail7558 changed discussion status to open
Owner

ctxlen means the length of your input

Sign up or log in to comment