Pooja Ganesh
commited on
Commit
•
1f02893
1
Parent(s):
45af8bf
Update README.md
Browse files
README.md
CHANGED
@@ -12,4 +12,21 @@ tags:
|
|
12 |
- facebook
|
13 |
- amd
|
14 |
- onnx
|
15 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
- facebook
|
13 |
- amd
|
14 |
- onnx
|
15 |
+
---
|
16 |
+
|
17 |
+
# meta-llama/Meta-Llama-3-8B
|
18 |
+
- ## Introduction
|
19 |
+
This model was created by applying [Quark](https://quark.docs.amd.com/latest/index.html) with calibration samples from Pile dataset, and applying [onnxruntime-genai model builder](https://github.com/microsoft/onnxruntime-genai/tree/main/src/python/py/models) to convert to ONNX.
|
20 |
+
- ## Quantization Strategy
|
21 |
+
- ***Quantized Layers***: TBD
|
22 |
+
- ***Weight***: TBD
|
23 |
+
- ## Quick Start
|
24 |
+
For quickstart, refer to AMD [RyzenAI-SW-EA](https://account.amd.com/en/member/ryzenai-sw-ea.html)
|
25 |
+
|
26 |
+
#### Evaluation scores
|
27 |
+
The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 6.753044.
|
28 |
+
|
29 |
+
#### License
|
30 |
+
Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.
|
31 |
+
|
32 |
+
license: llama3
|