| tags: | |
| - llamafile | |
| - GGUF | |
| base_model: TheBloke/dolphin-2_6-phi-2-GGUF | |
| ## dolphin-2_6-phi-2-llamafile | |
| llamafile lets you distribute and run LLMs with a single file. [announcement blog post](https://hacks.mozilla.org/2023/11/introducing-llamafile/) | |
| #### Downloads | |
| - [dolphin-2_6-phi-2.Q2_K-server.llamafile](https://huggingface.co/rabil/dolphin-2_6-phi-2-llamafile/resolve/main/dolphin-2_6-phi-2.Q2_K-server.llamafile) | |
| - [dolphin-2_6-phi-2.Q4_K_M-server.llamafile](https://huggingface.co/rabil/dolphin-2_6-phi-2-llamafile/resolve/main/dolphin-2_6-phi-2.Q4_K_M-server.llamafile) | |
| - [dolphin-2_6-phi-2.Q5_K_M-server.llamafile](https://huggingface.co/rabil/dolphin-2_6-phi-2-llamafile/resolve/main/dolphin-2_6-phi-2.Q5_K_M-server.llamafile) | |
| - [dolphin-2_6-phi-2.Q8_0-server.llamafile](https://huggingface.co/rabil/dolphin-2_6-phi-2-llamafile/resolve/main/dolphin-2_6-phi-2.Q8_0-server.llamafile) | |
| This repository was created using the [llamafile-builder](https://github.com/rabilrbl/llamafile-builder) | |