elysiantech
commited on
Commit
•
ff88ee2
1
Parent(s):
64b4b99
Update README.md
Browse files
README.md
CHANGED
@@ -28,5 +28,5 @@ phi-3-mini-4k-instruct-awq-4bit is a version of the [Microsoft](https://huggingf
|
|
28 |
Please refer to the [Original Phi 3 mini model card](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) for details about the model preparation and training processes.
|
29 |
|
30 |
## Dependencies
|
31 |
-
- [`autoawq==0.2.5`](https://pypi.org/project/autoawq/0.2.5/) – [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) was used to quantize the
|
32 |
- [`vllm==0.4.2`](https://pypi.org/project/vllm/0.4.2/) – [vLLM](https://github.com/vllm-project/vllm) was used to host models for benchmarking.
|
|
|
28 |
Please refer to the [Original Phi 3 mini model card](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) for details about the model preparation and training processes.
|
29 |
|
30 |
## Dependencies
|
31 |
+
- [`autoawq==0.2.5`](https://pypi.org/project/autoawq/0.2.5/) – [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) was used to quantize the phi-3 model.
|
32 |
- [`vllm==0.4.2`](https://pypi.org/project/vllm/0.4.2/) – [vLLM](https://github.com/vllm-project/vllm) was used to host models for benchmarking.
|