| Quantized versions of MobileLLaMA-1.4B-Chat. | |
| - Q4_K: [download link](https://huggingface.co/azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q4_K.gguf?download=true) | |
| - Q5_K: [download link](https://huggingface.co/azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q5_K.gguf?download=true) | |
| - Q6_K: [download link](https://huggingface.co/azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q6_K.gguf?download=true) | |
| Original model: https://huggingface.co/mtgv/MobileLLaMA-1.4B-Chat |