Context length
#3
by
mrfakename
- opened
Hi,
I saw that the context length on this model is 2k. Are there any plans to release a long context version in the future?
Thanks!
@mrfakename the 8b has 4k and 20 and 34b have 8k lengths
Nice! Would be nice to have some longer-context SLMs, are there any plans for that?
Yes
@mrfakename
we are planning long context length models.
Hopefully sometime soon :)
Thanks!
closing this :)
mayank-mishra
changed discussion status to
closed