Quantized versions of MobileLLaMA-1.4B-Chat.

- Q4_K: [download link](https://huggingface.co/azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q4_K.gguf?download=true)
- Q5_K: [download link](https://huggingface.co/azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q5_K.gguf?download=true)
- Q6_K: [download link](https://huggingface.co/azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q6_K.gguf?download=true)

Original model: https://huggingface.co/mtgv/MobileLLaMA-1.4B-Chat