amd
/

Phi-3.5-mini-instruct-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Text Generation

Inference Endpoints

Model card Files Files and versions Community

pooja-ganesh commited on 9 days ago

Commit

e85fa42

•

1 Parent(s): eb80537

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ tags:
 - ## Quantization Strategy
   - AWQ / Group 128 / Asymmetric / BF16 activations
 - ## Quick Start
-For quickstart, refer to AMD [RyzenAI-SW-EA](https://account.amd.com/en/member/ryzenai-sw-ea.html)
 #### Evaluation scores
 The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 7.12716.

 - ## Quantization Strategy
   - AWQ / Group 128 / Asymmetric / BF16 activations
 - ## Quick Start
+  For quickstart, refer to npu-llm-artifacts_1.3.0.zip available in [RyzenAI-SW-EA](https://account.amd.com/en/member/ryzenai-sw-ea.html)
 #### Evaluation scores
 The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 7.12716.