---
license: mit
---

4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct).