Hi! Lama-2 has context-sizeof 4096, but in interact_llamacpp.py we can see n_ctx=2000 - is it true, what is the size of the Saiga-2 context?
Yes, it is still 2000
· Sign up or log in to comment
