File size: 299 Bytes
e6ca7e2 9b8ad61 |
1 2 |
Phi-3-mini-128k-instruct-awq is a quantized version of the June'24 version of [Phi-3-mini-128k-instruct](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct) created by [AutoAWQ](https://github.com/casper-hansen/AutoAWQ).
[Requires vllm>=v0.5.1](https://github.com/vllm-project/vllm/releases). |