| Phi-3-mini-128k-instruct-awq is a quantized version of the June'24 version of [Phi-3-mini-128k-instruct](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct) created by [AutoAWQ](https://github.com/casper-hansen/AutoAWQ). | |
| [Requires vllm>=v0.5.1](https://github.com/vllm-project/vllm/releases). |