What is the context size of this model?

#2
by TerraNull - opened

这个模型中文会出现乱码

SambaNova Systems org

Hi TerraNull! the context size is 2048, but given the alibi position embedding theoretically you can do more during inference :)

Hey zhouyiqq! thanks for the feedback, we will append this comment to our TODO list, thanks!

ChangranHuuu changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment