qaihm-bot commited on
Commit
f2e13b5
·
verified ·
1 Parent(s): e98863f

See https://github.com/quic/ai-hub-models/releases/v0.30.5 for changelog.

Files changed (3) hide show
  1. README.md +63 -63
  2. XLSR_w8a8.onnx +2 -2
  3. XLSR_w8a8.tflite +2 -2
README.md CHANGED
@@ -35,67 +35,67 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 7.785 ms | 3 - 14 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
39
- | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 2.345 ms | 0 - 10 MB | NPU | Use Export Script |
40
- | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 4.906 ms | 0 - 25 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
41
- | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 1.156 ms | 0 - 20 MB | NPU | Use Export Script |
42
- | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.124 ms | 0 - 8 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
43
- | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.833 ms | 0 - 4 MB | NPU | Use Export Script |
44
- | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 4.185 ms | 0 - 14 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
45
- | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 1.262 ms | 0 - 15 MB | NPU | Use Export Script |
46
- | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 7.785 ms | 3 - 14 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
47
- | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 2.345 ms | 0 - 10 MB | NPU | Use Export Script |
48
- | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.029 ms | 0 - 6 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
49
- | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.835 ms | 0 - 2 MB | NPU | Use Export Script |
50
- | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 4.538 ms | 6 - 23 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
51
- | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 1.23 ms | 0 - 19 MB | NPU | Use Export Script |
52
- | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.024 ms | 0 - 4 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
53
- | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.84 ms | 0 - 2 MB | NPU | Use Export Script |
54
- | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 4.185 ms | 0 - 14 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
55
- | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 1.262 ms | 0 - 15 MB | NPU | Use Export Script |
56
- | XLSR | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 2.927 ms | 0 - 9 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
57
- | XLSR | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.815 ms | 0 - 6 MB | NPU | Use Export Script |
58
- | XLSR | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 1.421 ms | 0 - 7 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
59
- | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.996 ms | 0 - 25 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
60
- | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.487 ms | 0 - 23 MB | NPU | Use Export Script |
61
- | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.859 ms | 0 - 19 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
62
- | XLSR | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.677 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
63
- | XLSR | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.49 ms | 0 - 20 MB | NPU | Use Export Script |
64
- | XLSR | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.694 ms | 0 - 15 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
65
- | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.92 ms | 0 - 0 MB | NPU | Use Export Script |
66
- | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.367 ms | 8 - 8 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
67
- | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 2.473 ms | 0 - 11 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
68
- | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 0.924 ms | 0 - 10 MB | NPU | Use Export Script |
69
- | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.222 ms | 0 - 25 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
70
- | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 0.619 ms | 0 - 21 MB | NPU | Use Export Script |
71
- | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.072 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
72
- | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.414 ms | 0 - 11 MB | NPU | Use Export Script |
73
- | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.801 ms | 0 - 15 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
74
- | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 0.595 ms | 0 - 14 MB | NPU | Use Export Script |
75
- | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.452 ms | 2 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
76
- | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN | 0.975 ms | 0 - 14 MB | NPU | Use Export Script |
77
- | XLSR | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 14.944 ms | 4 - 12 MB | GPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
78
- | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 2.473 ms | 0 - 11 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
79
- | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN | 0.924 ms | 0 - 10 MB | NPU | Use Export Script |
80
- | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.077 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
81
- | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.403 ms | 0 - 3 MB | NPU | Use Export Script |
82
- | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.881 ms | 2 - 22 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
83
- | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN | 0.729 ms | 0 - 18 MB | NPU | Use Export Script |
84
- | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.061 ms | 0 - 9 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
85
- | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.411 ms | 0 - 2 MB | NPU | Use Export Script |
86
- | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.801 ms | 0 - 15 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
87
- | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN | 0.595 ms | 0 - 14 MB | NPU | Use Export Script |
88
- | XLSR | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.053 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
89
- | XLSR | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.409 ms | 0 - 11 MB | NPU | Use Export Script |
90
- | XLSR | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 1.259 ms | 0 - 7 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
91
- | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.887 ms | 0 - 23 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
92
  | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.243 ms | 0 - 23 MB | NPU | Use Export Script |
93
- | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.926 ms | 5 - 27 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
94
- | XLSR | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.15 ms | 0 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
95
- | XLSR | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.202 ms | 0 - 18 MB | NPU | Use Export Script |
96
- | XLSR | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.701 ms | 0 - 15 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
97
- | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.491 ms | 0 - 0 MB | NPU | Use Export Script |
98
- | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.229 ms | 9 - 9 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
99
 
100
 
101
 
@@ -160,7 +160,7 @@ XLSR
160
  Device : cs_8275 (ANDROID 14)
161
  Runtime : TFLITE
162
  Estimated inference time (ms) : 7.8
163
- Estimated peak memory usage (MB): [3, 14]
164
  Total # Ops : 17
165
  Compute Unit(s) : npu (14 ops) gpu (0 ops) cpu (3 ops)
166
  ```
@@ -249,13 +249,13 @@ AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
249
  You can also run the demo on-device.
250
 
251
  ```bash
252
- python -m qai_hub_models.models.xlsr.demo --on-device
253
  ```
254
 
255
  **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
256
  environment, please add the following to your cell (instead of the above).
257
  ```
258
- %run -m qai_hub_models.models.xlsr.demo -- --on-device
259
  ```
260
 
261
 
 
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 7.83 ms | 6 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
39
+ | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 2.32 ms | 0 - 10 MB | NPU | Use Export Script |
40
+ | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 4.55 ms | 6 - 27 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
41
+ | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 1.038 ms | 0 - 19 MB | NPU | Use Export Script |
42
+ | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.889 ms | 0 - 4 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
43
+ | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.816 ms | 0 - 3 MB | NPU | Use Export Script |
44
+ | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 4.21 ms | 6 - 20 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
45
+ | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 1.225 ms | 0 - 12 MB | NPU | Use Export Script |
46
+ | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 7.83 ms | 6 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
47
+ | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 2.32 ms | 0 - 10 MB | NPU | Use Export Script |
48
+ | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.961 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
49
+ | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.81 ms | 0 - 9 MB | NPU | Use Export Script |
50
+ | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 6.344 ms | 6 - 26 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
51
+ | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 1.388 ms | 0 - 17 MB | NPU | Use Export Script |
52
+ | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.21 ms | 6 - 13 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
53
+ | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.811 ms | 0 - 2 MB | NPU | Use Export Script |
54
+ | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 4.21 ms | 6 - 20 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
55
+ | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 1.225 ms | 0 - 12 MB | NPU | Use Export Script |
56
+ | XLSR | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 3.068 ms | 6 - 14 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
57
+ | XLSR | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.836 ms | 0 - 5 MB | NPU | Use Export Script |
58
+ | XLSR | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 1.348 ms | 0 - 5 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
59
+ | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.888 ms | 0 - 25 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
60
+ | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.472 ms | 0 - 23 MB | NPU | Use Export Script |
61
+ | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.829 ms | 0 - 21 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
62
+ | XLSR | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 2.177 ms | 6 - 24 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
63
+ | XLSR | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.417 ms | 0 - 15 MB | NPU | Use Export Script |
64
+ | XLSR | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.702 ms | 0 - 17 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
65
+ | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.973 ms | 0 - 0 MB | NPU | Use Export Script |
66
+ | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.408 ms | 9 - 9 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx) |
67
+ | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.84 ms | 1 - 12 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
68
+ | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 0.896 ms | 0 - 10 MB | NPU | Use Export Script |
69
+ | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.37 ms | 0 - 20 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
70
+ | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 0.513 ms | 0 - 21 MB | NPU | Use Export Script |
71
+ | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.077 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
72
+ | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.391 ms | 0 - 2 MB | NPU | Use Export Script |
73
+ | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.736 ms | 0 - 13 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
74
+ | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 0.61 ms | 0 - 12 MB | NPU | Use Export Script |
75
+ | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 2.119 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
76
+ | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN | 1.143 ms | 0 - 12 MB | NPU | Use Export Script |
77
+ | XLSR | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 16.308 ms | 4 - 12 MB | GPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
78
+ | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.84 ms | 1 - 12 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
79
+ | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN | 0.896 ms | 0 - 10 MB | NPU | Use Export Script |
80
+ | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.057 ms | 2 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
81
+ | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.4 ms | 0 - 2 MB | NPU | Use Export Script |
82
+ | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.738 ms | 0 - 20 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
83
+ | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN | 0.758 ms | 0 - 18 MB | NPU | Use Export Script |
84
+ | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.047 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
85
+ | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.405 ms | 0 - 2 MB | NPU | Use Export Script |
86
+ | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.736 ms | 0 - 13 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
87
+ | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN | 0.61 ms | 0 - 12 MB | NPU | Use Export Script |
88
+ | XLSR | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.063 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
89
+ | XLSR | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.41 ms | 0 - 10 MB | NPU | Use Export Script |
90
+ | XLSR | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 1.437 ms | 0 - 4 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
91
+ | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.83 ms | 0 - 21 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
92
  | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.243 ms | 0 - 23 MB | NPU | Use Export Script |
93
+ | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.96 ms | 0 - 20 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
94
+ | XLSR | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.378 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
95
+ | XLSR | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.252 ms | 0 - 18 MB | NPU | Use Export Script |
96
+ | XLSR | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.779 ms | 0 - 17 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
97
+ | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.584 ms | 0 - 0 MB | NPU | Use Export Script |
98
+ | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.363 ms | 8 - 8 MB | NPU | [XLSR.onnx](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx) |
99
 
100
 
101
 
 
160
  Device : cs_8275 (ANDROID 14)
161
  Runtime : TFLITE
162
  Estimated inference time (ms) : 7.8
163
+ Estimated peak memory usage (MB): [6, 18]
164
  Total # Ops : 17
165
  Compute Unit(s) : npu (14 ops) gpu (0 ops) cpu (3 ops)
166
  ```
 
249
  You can also run the demo on-device.
250
 
251
  ```bash
252
+ python -m qai_hub_models.models.xlsr.demo --eval-mode on-device
253
  ```
254
 
255
  **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
256
  environment, please add the following to your cell (instead of the above).
257
  ```
258
+ %run -m qai_hub_models.models.xlsr.demo -- --eval-mode on-device
259
  ```
260
 
261
 
XLSR_w8a8.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9935b6aab43fffce783a3f45457e58f228778fbbc49f386b97ebfa01835ebbe0
3
- size 132209
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25cd49230bb8718226e30a02ac4a588a8e4140539f154d2c61186cedae8622c8
3
+ size 134296
XLSR_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72c0e256ea5da9e57d0f5db40489618ab24d327fad0e68868a08965f71e5d127
3
- size 46808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ba249182f54bd3630127542d2a1691c47740fa7e023a269f083675d64779843
3
+ size 46728