Hugging Face's logo

qualcomm
/
Llama-v2-7B-Chat

Text Generation
PyTorch
llm
generative_ai
quantized
android
Model card Files Community
4
qaihm-bot commited on
Commit
a41ec2c
•
1 Parent(s): fbcea26

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -41,8 +41,8 @@ accross various devices, can be found [here](https://aihub.qualcomm.com/models/l
41
 
42
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
43
  | ---|---|---|---|---|---|---|---|
44
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 117.812 ms | 66 - 238 MB | UINT16 | NPU | Llama-TokenGenerator-KVCache-Quantized
45
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 2578.521 ms | 12 - 17 MB | UINT16 | NPU | Llama-PromptProcessor-Quantized
46
 
47
 
48
  ## License
 
41
 
42
  | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
43
  | ---|---|---|---|---|---|---|---|
44
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 104.953 ms | 316 - 4785 MB | UINT16 | NPU | Llama-TokenGenerator-KVCache-Quantized
45
+ | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1917.811 ms | 0 - 1028 MB | UINT16 | NPU | Llama-PromptProcessor-Quantized
46
 
47
 
48
  ## License