Yolo-v5: Optimized for Qualcomm Devices

YoloV5 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of Yolo-v5 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for Yolo-v5 on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Input resolution: 640x640
  • Model checkpoint: YoloV5-M
  • Model size (float): 81.1 MB
  • Model size (w8a16): 21.8 MB
  • Number of parameters: 21.2M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
Yolo-v5 ONNX float Snapdragon® X2 Elite 7.252 ms 5 - 5 MB NPU
Yolo-v5 ONNX float Snapdragon® X Elite 13.542 ms 47 - 47 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Gen 3 Mobile 9.613 ms 1 - 243 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Gen 1 Mobile 27.927 ms 1 - 271 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-8275 22.529 ms 5 - 13 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 12.929 ms 0 - 53 MB NPU
Yolo-v5 ONNX float Qualcomm® QCS8450 27.927 ms 1 - 271 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-9075 20.13 ms 5 - 12 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-X7181 13.542 ms 47 - 47 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ Q-8750 7.5 ms 3 - 205 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Elite Mobile 7.5 ms 3 - 205 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Elite Gen 5 Mobile 5.779 ms 4 - 217 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® X2 Elite 5.038 ms 2 - 2 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® X Elite 10.317 ms 24 - 24 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 6.407 ms 3 - 304 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 14.327 ms 3 - 306 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 51.1 ms 2 - 5 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 9.094 ms 2 - 6 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 9.749 ms 0 - 28 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® QCS8450 14.327 ms 3 - 306 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 9.946 ms 2 - 5 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 10.317 ms 24 - 24 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 128.46 ms 5 - 294 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 14.49 ms 3 - 270 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 5.558 ms 2 - 264 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Elite Mobile 5.558 ms 2 - 264 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 4.363 ms 0 - 271 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 14.49 ms 3 - 270 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® X2 Elite 6.748 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® X Elite 12.215 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Gen 3 Mobile 8.562 ms 5 - 241 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Gen 1 Mobile 26.043 ms 5 - 261 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 19.445 ms 5 - 12 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.549 ms 5 - 136 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8775P 17.476 ms 1 - 194 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8650P 17.476 ms 1 - 194 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8255P 17.476 ms 1 - 194 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® QCS8450 26.043 ms 5 - 261 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 17.713 ms 7 - 13 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 12.215 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ Q-8750 6.479 ms 0 - 195 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA7255P 63.857 ms 0 - 194 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8295P 22.203 ms 0 - 220 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Elite Mobile 6.479 ms 0 - 195 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 5.006 ms 5 - 211 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® X2 Elite 4.405 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® X Elite 9.552 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 5.848 ms 2 - 278 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 13.463 ms 2 - 280 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 48.386 ms 4 - 8 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 8.333 ms 2 - 7 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.739 ms 2 - 210 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8775P 8.988 ms 2 - 234 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8650P 8.988 ms 2 - 234 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8255P 8.988 ms 2 - 234 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® QCS8450 13.463 ms 2 - 280 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 8.721 ms 2 - 6 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 9.552 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 126.256 ms 2 - 271 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 12.566 ms 2 - 251 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 4.241 ms 2 - 240 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA7255P 21.01 ms 1 - 232 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8295P 12.569 ms 0 - 235 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 4.241 ms 2 - 240 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 3.348 ms 2 - 246 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 12.566 ms 2 - 251 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Gen 3 Mobile 8.24 ms 0 - 283 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Gen 1 Mobile 25.659 ms 0 - 312 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ IQ-8275 18.926 ms 0 - 58 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.025 ms 0 - 3 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8775P 17.007 ms 0 - 223 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8650P 17.007 ms 0 - 223 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8255P 17.007 ms 0 - 223 MB NPU
Yolo-v5 TFLITE float Qualcomm® QCS8450 25.659 ms 0 - 312 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ IQ-9075 16.8 ms 0 - 57 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ Q-8750 6.178 ms 0 - 227 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA7255P 63.142 ms 0 - 222 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8295P 21.588 ms 0 - 249 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Elite Mobile 6.178 ms 0 - 227 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 4.621 ms 0 - 234 MB NPU

License

  • The license for the original implementation of Yolo-v5 can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support