Quantization made by Richard Erkhov. [Github](https://github.com/RichardErkhov) [Discord](https://discord.gg/pvy7H8DZMG) [Request more models](https://github.com/RichardErkhov/quant_request) phi-3.8-flight - GGUF - Model creator: https://huggingface.co/SameedHussain/ - Original model: https://huggingface.co/SameedHussain/phi-3.8-flight/ | Name | Quant method | Size | | ---- | ---- | ---- | | [phi-3.8-flight.Q2_K.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q2_K.gguf) | Q2_K | 1.35GB | | [phi-3.8-flight.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.IQ3_XS.gguf) | IQ3_XS | 1.49GB | | [phi-3.8-flight.IQ3_S.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.IQ3_S.gguf) | IQ3_S | 1.57GB | | [phi-3.8-flight.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q3_K_S.gguf) | Q3_K_S | 1.57GB | | [phi-3.8-flight.IQ3_M.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.IQ3_M.gguf) | IQ3_M | 1.65GB | | [phi-3.8-flight.Q3_K.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q3_K.gguf) | Q3_K | 1.75GB | | [phi-3.8-flight.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q3_K_M.gguf) | Q3_K_M | 1.75GB | | [phi-3.8-flight.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q3_K_L.gguf) | Q3_K_L | 1.9GB | | [phi-3.8-flight.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.IQ4_XS.gguf) | IQ4_XS | 1.93GB | | [phi-3.8-flight.Q4_0.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q4_0.gguf) | Q4_0 | 2.03GB | | [phi-3.8-flight.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.IQ4_NL.gguf) | IQ4_NL | 2.04GB | | [phi-3.8-flight.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q4_K_S.gguf) | Q4_K_S | 2.04GB | | [phi-3.8-flight.Q4_K.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q4_K.gguf) | Q4_K | 2.16GB | | [phi-3.8-flight.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q4_K_M.gguf) | Q4_K_M | 2.16GB | | [phi-3.8-flight.Q4_1.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q4_1.gguf) | Q4_1 | 2.24GB | | [phi-3.8-flight.Q5_0.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q5_0.gguf) | Q5_0 | 2.46GB | | [phi-3.8-flight.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q5_K_S.gguf) | Q5_K_S | 2.46GB | | [phi-3.8-flight.Q5_K.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q5_K.gguf) | Q5_K | 2.53GB | | [phi-3.8-flight.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q5_K_M.gguf) | Q5_K_M | 2.53GB | | [phi-3.8-flight.Q5_1.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q5_1.gguf) | Q5_1 | 2.68GB | | [phi-3.8-flight.Q6_K.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q6_K.gguf) | Q6_K | 2.92GB | | [phi-3.8-flight.Q8_0.gguf](https://huggingface.co/RichardErkhov/SameedHussain_-_phi-3.8-flight-gguf/blob/main/phi-3.8-flight.Q8_0.gguf) | Q8_0 | 3.78GB | Original model description: --- base_model: unsloth/phi-3-mini-4k-instruct-bnb-4bit language: - en license: apache-2.0 tags: - text-generation-inference - transformers - unsloth - mistral - trl - sft --- # Uploaded model - **Developed by:** SameedHussain - **License:** apache-2.0 - **Finetuned from model :** unsloth/phi-3-mini-4k-instruct-bnb-4bit This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. [](https://github.com/unslothai/unsloth)