| Phi-3-mini-128k-instruct-awq is a quantized version of Phi-3-mini-128k-instruct created by [AutoAWQ](https://github.com/casper-hansen/AutoAWQ). | |
| [Requires vllm>=v0.5.1](https://github.com/vllm-project/vllm/releases). |
| Phi-3-mini-128k-instruct-awq is a quantized version of Phi-3-mini-128k-instruct created by [AutoAWQ](https://github.com/casper-hansen/AutoAWQ). | |
| [Requires vllm>=v0.5.1](https://github.com/vllm-project/vllm/releases). |