OliP
/

Phi-3-mini-128k-instruct-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

OliP commited on Jul 9

Commit

9b8ad61

•

1 Parent(s): 5295626

Create README.md

Files changed (1) hide show

README.md +2 -0

README.md ADDED Viewed

	@@ -0,0 +1,2 @@


1	+ Phi-3-mini-128k-instruct-awq is a quantized version of Phi-3-mini-128k-instruct created by [AutoAWQ](https://github.com/casper-hansen/AutoAWQ).
2	+ [Requires vllm>=v0.5.1](https://github.com/vllm-project/vllm/releases).