This repository holds a Q4_K_M GGUF of Mistral Instruct v0.2 with the config.json swapped with their own v0.2 completions model config.json obtained directly from their CDN.
I can not manage to get it to use all 32k or 29k context but maybe this is user error.
- Downloads last month
- 0
Unable to determine this model's library. Check the
docs
.