OliP
/

Phi-3-mini-128k-instruct-awq

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Phi-3-mini-128k-instruct-awq / README.md

OliP's picture

Create README.md

9b8ad61 verified 3 months ago

|

215 Bytes

Phi-3-mini-128k-instruct-awq is a quantized version of Phi-3-mini-128k-instruct created by AutoAWQ. Requires vllm>=v0.5.1.