qaihm-bot's picture
v0.60.0
f1904cf verified
|
Raw
History Blame Contribute Delete
19.9 kB
metadata
library_name: pytorch
license: other
tags:
  - android
pipeline_tag: image-segmentation

MediaPipe-Selfie-Segmentation: Optimized for Qualcomm Devices

Light-weight model that segments a person from the background in square or landscape selfie and video conference imagery.

This is based on the implementation of MediaPipe-Selfie-Segmentation found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
ONNX w8a16 Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
ONNX w8a8 Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
QNN_DLC float Universal QAIRT 2.45 Download
QNN_DLC w8a16 Universal QAIRT 2.45 Download
QNN_DLC w8a8 Universal QAIRT 2.45 Download
TFLITE float Universal QAIRT 2.45 Download
TFLITE w8a8 Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit MediaPipe-Selfie-Segmentation on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for MediaPipe-Selfie-Segmentation on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.semantic_segmentation

Model Stats:

  • Input resolution (Landscape): 144x256
  • Input resolution (Square): 256x256
  • Model checkpoint: Square
  • Model size (float): 447 KB
  • Number of output classes: 6
  • Number of parameters: 106K

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
MediaPipe-Selfie-Segmentation ONNX float Snapdragon® X2 Elite 0.378 ms 2 - 2 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Snapdragon® X Elite 0.792 ms 2 - 2 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Snapdragon® 8 Gen 3 Mobile 0.531 ms 0 - 38 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Snapdragon® 8 Gen 1 Mobile 1.092 ms 1 - 44 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Qualcomm® Dragonwing™ IQ-8275 0.953 ms 1 - 5 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.784 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Qualcomm® QCS8450 1.092 ms 1 - 44 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Qualcomm® Dragonwing™ IQ-9075 0.984 ms 1 - 4 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Qualcomm® Dragonwing™ IQ-X7181 0.792 ms 2 - 2 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Qualcomm® Dragonwing™ Q-8750 0.41 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Snapdragon® 8 Elite Mobile 0.41 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation ONNX float Snapdragon® 8 Elite Gen 5 Mobile 0.377 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® X2 Elite 0.388 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® X Elite 0.86 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 0.55 ms 0 - 42 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 1.031 ms 0 - 47 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 2.79 ms 1 - 3 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 0.832 ms 0 - 4 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.831 ms 0 - 71 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® QCS8450 1.031 ms 0 - 47 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 0.964 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 0.86 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 2.405 ms 0 - 144 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 0.682 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 0.445 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® 8 Elite Mobile 0.445 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 0.384 ms 0 - 34 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 0.682 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® X2 Elite 0.179 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® X Elite 0.355 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 0.252 ms 0 - 40 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 0.458 ms 0 - 42 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 0.966 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 0.462 ms 0 - 4 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.364 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® QCS8450 0.458 ms 0 - 42 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 0.486 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 0.355 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 0.967 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 0.356 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 0.2 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® 8 Elite Mobile 0.2 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.194 ms 0 - 29 MB NPU
MediaPipe-Selfie-Segmentation ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 0.356 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Snapdragon® X2 Elite 0.426 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Snapdragon® X Elite 0.806 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Snapdragon® 8 Gen 3 Mobile 0.455 ms 0 - 36 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Snapdragon® 8 Gen 1 Mobile 0.928 ms 0 - 42 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 0.777 ms 1 - 4 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 1.796 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.682 ms 1 - 32 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® SA8775P 0.959 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® SA8650P 0.959 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® SA8255P 0.959 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® QCS8450 0.928 ms 0 - 42 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 1.069 ms 1 - 3 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 0.806 ms 1 - 1 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® Dragonwing™ Q-8750 0.377 ms 1 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® SA7255P 1.796 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Qualcomm® SA8295P 1.262 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Snapdragon® 8 Elite Mobile 0.377 ms 1 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 0.323 ms 1 - 29 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® X2 Elite 0.42 ms 0 - 0 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® X Elite 0.728 ms 0 - 0 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 0.421 ms 0 - 35 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 0.763 ms 0 - 41 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 2.544 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 0.658 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 1.334 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.609 ms 0 - 12 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® SA8775P 0.815 ms 0 - 29 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® SA8650P 0.815 ms 0 - 29 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® SA8255P 0.815 ms 0 - 29 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® QCS8450 0.763 ms 0 - 41 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 0.737 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 0.728 ms 0 - 0 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 2.062 ms 0 - 138 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 0.609 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 0.329 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Qualcomm® SA7255P 1.334 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 0.329 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 0.265 ms 0 - 30 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 0.609 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® X2 Elite 0.217 ms 0 - 0 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® X Elite 0.348 ms 0 - 0 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 0.184 ms 0 - 31 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 0.331 ms 0 - 38 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 0.85 ms 0 - 2 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 0.303 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 0.667 ms 0 - 24 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.263 ms 0 - 6 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® SA8775P 0.438 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® SA8650P 0.438 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® SA8255P 0.438 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® QCS8450 0.331 ms 0 - 38 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 0.353 ms 0 - 2 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 0.348 ms 0 - 0 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 0.833 ms 0 - 23 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 0.252 ms 0 - 23 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 0.142 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Qualcomm® SA7255P 0.667 ms 0 - 24 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 0.142 ms 0 - 27 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.141 ms 0 - 23 MB NPU
MediaPipe-Selfie-Segmentation QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 0.252 ms 0 - 23 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Snapdragon® 8 Gen 3 Mobile 0.457 ms 0 - 36 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Snapdragon® 8 Gen 1 Mobile 0.938 ms 0 - 43 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® Dragonwing™ IQ-8275 0.79 ms 0 - 4 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® Dragonwing™ IQ-8275 1.8 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.691 ms 0 - 33 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® SA8775P 0.981 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® SA8650P 0.981 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® SA8255P 0.981 ms 0 - 28 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® QCS8450 0.938 ms 0 - 43 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® Dragonwing™ IQ-9075 0.855 ms 0 - 4 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® Dragonwing™ Q-8750 0.365 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® SA7255P 1.8 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Qualcomm® SA8295P 1.295 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Snapdragon® 8 Elite Mobile 0.365 ms 0 - 25 MB NPU
MediaPipe-Selfie-Segmentation TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 0.331 ms 0 - 32 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 0.185 ms 0 - 30 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 0.344 ms 0 - 37 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 0.85 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 0.346 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 0.721 ms 0 - 23 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.26 ms 0 - 3 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® SA8775P 0.457 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® SA8650P 0.457 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® SA8255P 0.457 ms 0 - 26 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® QCS8450 0.344 ms 0 - 37 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 0.371 ms 0 - 2 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 0.845 ms 0 - 22 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 0.259 ms 0 - 21 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 0.151 ms 0 - 22 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® SA7255P 0.721 ms 0 - 23 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Qualcomm® SA8295P 0.619 ms 0 - 22 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Snapdragon® 8 Elite Mobile 0.151 ms 0 - 22 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.142 ms 0 - 22 MB NPU
MediaPipe-Selfie-Segmentation TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 0.259 ms 0 - 21 MB NPU

License

  • The license for the original implementation of MediaPipe-Selfie-Segmentation can be found here.

References

Community