jondurbin

/

airoboros-m-7b-3.1.2

like 46

Hi, I remember there were some issues with context extension to 4096 earlier with Airoboros. Has the use of Mistral helped with that? What's the attested safe context size now? I'm looking to use context obedience, and of course that format can chew up a lot of tokens. Thanks!