File size: 834 Bytes
2658ec4 92c5d6d 2658ec4 92c5d6d c09e69c 2658ec4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
## Mistral-7B-Instruct-v0.2-llamafile
llamafile lets you distribute and run LLMs with a single file. [announcement blog post](https://hacks.mozilla.org/2023/11/introducing-llamafile/)
#### Downloads
- [mistral-7b-instruct-v0.2.Q4_K_M.llamafile](https://huggingface.co/rabil/Mistral-7B-Instruct-v0.2-llamafile/resolve/main/mistral-7b-instruct-v0.2.Q4_K_M.llamafile)
- [mistral-7b-instruct-v0.2.Q5_K_M-server.llamafile](https://huggingface.co/rabil/Mistral-7B-Instruct-v0.2-llamafile/resolve/main/mistral-7b-instruct-v0.2.Q5_K_M-server.llamafile)
- [mistral-7b-instruct-v0.2.Q8_0-server.llamafile](https://huggingface.co/rabil/Mistral-7B-Instruct-v0.2-llamafile/resolve/main/mistral-7b-instruct-v0.2.Q8_0-server.llamafile)
This repository was created using the [llamafile-builder](https://github.com/rabilrbl/llamafile-builder)
|