Context length

#3
by mrfakename - opened

Hi,
I saw that the context length on this model is 2k. Are there any plans to release a long context version in the future?
Thanks!

IBM Granite org

@mrfakename the 8b has 4k and 20 and 34b have 8k lengths

Nice! Would be nice to have some longer-context SLMs, are there any plans for that?

IBM Granite org

Yes @mrfakename we are planning long context length models.
Hopefully sometime soon :)

Thanks!

IBM Granite org

closing this :)

mayank-mishra changed discussion status to closed

Sign up or log in to comment