Hugging Face's logo

qualcomm
/
Video-MAE

Video Classification
PyTorch
LiteRT
backbone
android
Model card Files
xet
Community
qaihm-bot commited on
Commit
9fc7de2
·
verified ·
1 Parent(s): 673fd52

v0.44.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.44.0 for changelog.

Files changed (6) hide show
  1. DEPLOYMENT_MODEL_LICENSE.pdf +0 -3
  2. LICENSE +0 -1
  3. README.md +29 -31
  4. Video-MAE_float.dlc +1 -1
  5. Video-MAE_float.onnx.zip +2 -2
  6. Video-MAE_float.tflite +2 -2
DEPLOYMENT_MODEL_LICENSE.pdf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:4409f93b0e82531303b3e10f52f1fdfb56467a25f05b7441c6bbd8bb8a64b42c
3
- size 109629
 
 
 
 
LICENSE CHANGED
@@ -1,2 +1 @@
1
  The license of the original trained model can be found at https://github.com/MCG-NJU/VideoMAE/blob/main/LICENSE.
2
- The license for the deployable model files (.tflite, .onnx, .dlc, .bin, etc.) can be found in DEPLOYMENT_MODEL_LICENSE.pdf.
 
1
  The license of the original trained model can be found at https://github.com/MCG-NJU/VideoMAE/blob/main/LICENSE.
 
README.md CHANGED
@@ -36,36 +36,35 @@ More details on model performance across various devices, can be found
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
- | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 438.445 ms | 0 - 544 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
40
- | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1061.481 ms | 0 - 480 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
41
- | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 216.846 ms | 0 - 501 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
42
- | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 578.163 ms | 9 - 456 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
43
- | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 146.481 ms | 0 - 37 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
44
- | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 496.743 ms | 9 - 78 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
45
- | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 573.621 ms | 0 - 261 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
46
- | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 754.522 ms | 0 - 545 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
47
- | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 500.58 ms | 0 - 518 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
48
- | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 438.445 ms | 0 - 544 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
49
- | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1061.481 ms | 0 - 480 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
50
- | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 143.923 ms | 0 - 42 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
51
- | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 497.591 ms | 9 - 94 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
52
- | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 236.105 ms | 0 - 498 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
53
- | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 669.407 ms | 1 - 497 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
54
- | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 145.9 ms | 0 - 45 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
55
- | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 497.075 ms | 9 - 73 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
56
- | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 754.522 ms | 0 - 545 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
57
- | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 500.58 ms | 0 - 518 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
58
- | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 107.773 ms | 0 - 543 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
59
- | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 348.884 ms | 9 - 489 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
60
- | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 416.917 ms | 7 - 618 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
61
- | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 79.669 ms | 0 - 527 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
62
- | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 258.724 ms | 9 - 498 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
63
- | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 439.051 ms | 0 - 613 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
64
- | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 66.867 ms | 0 - 513 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
65
- | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 270.119 ms | 9 - 528 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
66
- | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 595.889 ms | 9 - 631 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
67
- | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 515.265 ms | 663 - 663 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
68
- | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 599.335 ms | 187 - 187 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
69
 
70
 
71
 
@@ -228,7 +227,6 @@ Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
228
  ## License
229
  * The license for the original implementation of Video-MAE can be found
230
  [here](https://github.com/MCG-NJU/VideoMAE/blob/main/LICENSE).
231
- * The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
232
 
233
 
234
 
 
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
+ | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 423.568 ms | 0 - 908 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
40
+ | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1136.783 ms | 4 - 851 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
41
+ | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 291.792 ms | 1 - 1054 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
42
+ | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 575.304 ms | 9 - 1005 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
43
+ | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 139.117 ms | 0 - 5 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
44
+ | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 495.828 ms | 9 - 12 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
45
+ | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 572.575 ms | 0 - 217 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
46
+ | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 723.049 ms | 0 - 901 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
47
+ | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 501.186 ms | 2 - 887 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
48
+ | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 423.568 ms | 0 - 908 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
49
+ | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1136.783 ms | 4 - 851 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
50
+ | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 137.958 ms | 0 - 5 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
51
+ | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 496.563 ms | 9 - 12 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
52
+ | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 669.5 ms | 0 - 845 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
53
+ | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 140.073 ms | 0 - 3 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
54
+ | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 497.383 ms | 9 - 11 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
55
+ | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 723.049 ms | 0 - 901 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
56
+ | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 501.186 ms | 2 - 887 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
57
+ | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 100.899 ms | 1 - 1109 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
58
+ | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 349.189 ms | 9 - 1059 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
59
+ | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 416.581 ms | 1 - 1183 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
60
+ | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 74.924 ms | 0 - 899 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
61
+ | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 259.329 ms | 9 - 867 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
62
+ | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 439.219 ms | 1 - 966 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
63
+ | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 59.82 ms | 1 - 913 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
64
+ | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 294.871 ms | 11 - 902 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
65
+ | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 593.719 ms | 9 - 989 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
66
+ | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 516.587 ms | 9 - 9 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
67
+ | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 599.153 ms | 187 - 187 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
 
68
 
69
 
70
 
 
227
  ## License
228
  * The license for the original implementation of Video-MAE can be found
229
  [here](https://github.com/MCG-NJU/VideoMAE/blob/main/LICENSE).
 
230
 
231
 
232
 
Video-MAE_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0094788168d553d1b8b5a5fc4e2c7679ee70d5edfd1585e90f30228478c2248
3
  size 351314884
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5809fa48eda668973b39cd9d074507cb4f3142ce11a9bf31e4ee5e3c96a8df49
3
  size 351314884
Video-MAE_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e72e766e324e9a1f8b36fdd2f48a705b543c3fdd1b8b0d161d7100f9fe2a3b60
3
- size 221427591
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c42437267f75e065a1c448a9e1a4ee0759b1e5634aba9c1fdfb80a9b06d014f7
3
+ size 221427620
Video-MAE_float.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01fa1f2460a83492c9e305febb4c572b09acc1c60881c014d9bffce0573a32fd
3
- size 351051840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05e2c7e3ae7a1ccc588bf07bcfa47af934ed473b9259558339d23a394fe7d2b3
3
+ size 351051860