YOLOv9-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv9-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YOLOv9-T
  • Input resolution: 640x640
  • Model size (float): 8.84 MB
  • Model size (w8a8): 3.23 MB
  • Model size (w8a8_mixed_int16): 3.74 MB
  • Model size (w8a16): 3.25 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv9-Detection ONNX float Snapdragon® X2 Elite 3.828 ms 208 - 208 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X Elite 10.795 ms 144 - 144 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 7.549 ms 0 - 251 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 1 Mobile 17.044 ms 5 - 241 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8550 (Proxy) 10.599 ms 5 - 15 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8450 17.044 ms 5 - 241 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Mobile 4.391 ms 0 - 210 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.478 ms 1 - 223 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS9075 10.103 ms 2 - 50 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8750 4.391 ms 0 - 210 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS7181 10.795 ms 144 - 144 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X2 Elite 91.211 ms 210 - 210 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X Elite 315.113 ms 178 - 178 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 228.221 ms 3 - 155 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 390.408 ms 3 - 153 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS6490 393.423 ms 1 - 48 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8550 (Proxy) 300.103 ms 2 - 7 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8450 390.408 ms 3 - 153 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 91.361 ms 1 - 133 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Mobile 115.271 ms 1 - 132 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS9075 174.637 ms 1 - 48 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 273.03 ms 3 - 253 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCM6690 647.528 ms 3 - 237 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS7790 273.03 ms 3 - 253 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8750 115.271 ms 1 - 132 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS7181 315.113 ms 178 - 178 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X2 Elite 110.891 ms 212 - 212 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X Elite 188.596 ms 178 - 178 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 136.469 ms 2 - 115 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 237.933 ms 0 - 111 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS6490 372.037 ms 0 - 47 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8550 (Proxy) 179.069 ms 0 - 8 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8450 237.933 ms 0 - 111 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS9075 190.413 ms 0 - 47 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCM6690 512.891 ms 1 - 221 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 171.706 ms 1 - 213 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.358 ms 1 - 99 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Mobile 143.677 ms 2 - 102 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS7790 171.706 ms 1 - 213 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8750 143.677 ms 2 - 102 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS7181 188.596 ms 178 - 178 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X2 Elite 7.579 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X Elite 8.786 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 5.937 ms 0 - 232 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 1 Mobile 13.846 ms 5 - 234 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8275 21.605 ms 0 - 203 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8550 (Proxy) 8.116 ms 5 - 10 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8450 13.846 ms 5 - 234 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Mobile 3.157 ms 5 - 212 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA7255P 21.605 ms 0 - 203 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8295P 13.375 ms 1 - 202 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 2.787 ms 5 - 213 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS9075 8.929 ms 5 - 11 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8750 3.157 ms 5 - 212 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS7181 8.786 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 80.299 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X Elite 224.398 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 165.603 ms 2 - 121 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 357.739 ms 2 - 124 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS6490 405.118 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8275 447.676 ms 2 - 93 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 214.155 ms 3 - 143 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8450 357.739 ms 2 - 124 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 79.701 ms 2 - 102 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 114.649 ms 2 - 97 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS9075 183.186 ms 3 - 7 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 286.232 ms 3 - 216 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCM6690 562.057 ms 1 - 202 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8295P 301.373 ms 0 - 91 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA7255P 447.676 ms 2 - 93 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS7790 286.232 ms 3 - 216 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8750 114.649 ms 2 - 97 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS7181 224.398 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 100.713 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X Elite 175.759 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 136.131 ms 1 - 80 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 237.878 ms 1 - 82 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS6490 407.295 ms 3 - 6 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8275 347.63 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 167.226 ms 1 - 3 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8450 237.878 ms 1 - 82 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS9075 189.461 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA7255P 347.63 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCM6690 510.416 ms 2 - 187 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 175.68 ms 0 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8295P 202.955 ms 0 - 61 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.471 ms 1 - 67 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 133.346 ms 2 - 68 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS7790 175.68 ms 0 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8750 133.346 ms 2 - 68 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS7181 175.759 ms 1 - 1 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 5.591 ms 0 - 123 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 1 Mobile 11.972 ms 0 - 110 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8275 21.018 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8550 (Proxy) 7.7 ms 0 - 2 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8775P 25.681 ms 3 - 39 MB GPU
YOLOv9-Detection TFLITE float Qualcomm® SA8650P 25.681 ms 3 - 39 MB GPU
YOLOv9-Detection TFLITE float Qualcomm® SA8255P 25.681 ms 3 - 39 MB GPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8450 11.972 ms 0 - 110 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Mobile 2.972 ms 0 - 102 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA7255P 21.018 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8295P 12.899 ms 0 - 76 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.296 ms 0 - 116 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS9075 8.507 ms 0 - 14 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8750 2.972 ms 0 - 102 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 136.354 ms 0 - 81 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 237.672 ms 0 - 81 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS6490 391.49 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8275 347.903 ms 0 - 60 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 167.006 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8775P 29.719 ms 8 - 46 MB GPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8650P 29.719 ms 8 - 46 MB GPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8255P 29.719 ms 8 - 46 MB GPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8450 237.672 ms 0 - 81 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS9075 190.285 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA7255P 347.903 ms 0 - 60 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCM6690 499.952 ms 0 - 186 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 178.635 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8295P 202.717 ms 0 - 57 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.334 ms 0 - 65 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Mobile 133.603 ms 1 - 66 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS7790 178.635 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8750 133.603 ms 1 - 66 MB NPU

License

  • The license for the original implementation of YOLOv9-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support