Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -38,10 +38,10 @@ More details on model performance across various devices, can be found
|
|
| 38 |
|
| 39 |
| Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
| 40 |
| ---|---|---|---|---|---|---|---|
|
| 41 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite |
|
| 42 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 26.
|
| 43 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library |
|
| 44 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 24.
|
| 45 |
|
| 46 |
|
| 47 |
|
|
@@ -104,15 +104,15 @@ python -m qai_hub_models.models.whisper_small_en.export
|
|
| 104 |
Profile Job summary of WhisperEncoder
|
| 105 |
--------------------------------------------------
|
| 106 |
Device: Snapdragon X Elite CRD (11)
|
| 107 |
-
Estimated Inference Time:
|
| 108 |
Estimated Peak Memory Range: 0.92-0.92 MB
|
| 109 |
Compute Units: NPU (1473) | Total (1473)
|
| 110 |
|
| 111 |
Profile Job summary of WhisperDecoder
|
| 112 |
--------------------------------------------------
|
| 113 |
Device: Snapdragon X Elite CRD (11)
|
| 114 |
-
Estimated Inference Time:
|
| 115 |
-
Estimated Peak Memory Range: 121.
|
| 116 |
Compute Units: NPU (2255) | Total (2255)
|
| 117 |
|
| 118 |
|
|
@@ -138,7 +138,6 @@ from qai_hub_models.models.whisper_small_en import Model
|
|
| 138 |
|
| 139 |
# Load the model
|
| 140 |
torch_model = Model.from_pretrained()
|
| 141 |
-
torch_model.eval()
|
| 142 |
|
| 143 |
# Device
|
| 144 |
device = hub.Device("Samsung Galaxy S23")
|
|
|
|
| 38 |
|
| 39 |
| Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
| 40 |
| ---|---|---|---|---|---|---|---|
|
| 41 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 615.85 ms | 53 - 482 MB | FP16 | GPU | [WhisperEncoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite)
|
| 42 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 26.012 ms | 16 - 20 MB | FP16 | NPU | [WhisperDecoder.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite)
|
| 43 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 1802.215 ms | 0 - 225 MB | FP16 | NPU | [WhisperEncoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.so)
|
| 44 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 24.923 ms | 115 - 186 MB | FP16 | NPU | [WhisperDecoder.so](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.so)
|
| 45 |
|
| 46 |
|
| 47 |
|
|
|
|
| 104 |
Profile Job summary of WhisperEncoder
|
| 105 |
--------------------------------------------------
|
| 106 |
Device: Snapdragon X Elite CRD (11)
|
| 107 |
+
Estimated Inference Time: 1093.55 ms
|
| 108 |
Estimated Peak Memory Range: 0.92-0.92 MB
|
| 109 |
Compute Units: NPU (1473) | Total (1473)
|
| 110 |
|
| 111 |
Profile Job summary of WhisperDecoder
|
| 112 |
--------------------------------------------------
|
| 113 |
Device: Snapdragon X Elite CRD (11)
|
| 114 |
+
Estimated Inference Time: 17.21 ms
|
| 115 |
+
Estimated Peak Memory Range: 121.47-121.47 MB
|
| 116 |
Compute Units: NPU (2255) | Total (2255)
|
| 117 |
|
| 118 |
|
|
|
|
| 138 |
|
| 139 |
# Load the model
|
| 140 |
torch_model = Model.from_pretrained()
|
|
|
|
| 141 |
|
| 142 |
# Device
|
| 143 |
device = hub.Device("Samsung Galaxy S23")
|