extend to 32k
#2
by
rinoa
- opened
Hello openbuddy team, thank you for sharing this amazing model. I'd like to know if you have any plan to extend ctx of this model to 32k?
Hi, for now we recommend to use our mistral/mixtral-series models for 32k-context tasks. For e.g.: https://huggingface.co/OpenBuddy/openbuddy-mistral-7b-v17.1-32k