Yolo-v5: Optimized for Qualcomm Devices

YoloV5 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of Yolo-v5 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for Yolo-v5 on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Input resolution: 640x640
  • Model checkpoint: YoloV5-M
  • Model size (float): 81.1 MB
  • Model size (w8a16): 21.8 MB
  • Number of parameters: 21.2M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
Yolo-v5 ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.72 ms 1 - 202 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Elite For Galaxy Mobile 7.41 ms 3 - 192 MB NPU
Yolo-v5 ONNX float Snapdragon® X2 Elite 7.128 ms 5 - 5 MB NPU
Yolo-v5 ONNX float Snapdragon® X Elite 14.801 ms 47 - 47 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Gen 3 Mobile 9.729 ms 3 - 234 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Gen 1 Mobile 27.064 ms 1 - 262 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-8275 22.987 ms 5 - 13 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 14.794 ms 0 - 54 MB NPU
Yolo-v5 ONNX float Qualcomm® QCS8450 27.064 ms 1 - 262 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-9075 21.423 ms 5 - 13 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-X7181 14.801 ms 47 - 47 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ Q-8750 7.41 ms 3 - 192 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.784 ms 0 - 259 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 4.925 ms 0 - 250 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® X2 Elite 4.527 ms 2 - 2 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® X Elite 10.317 ms 24 - 24 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 6.497 ms 3 - 296 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 13.425 ms 3 - 296 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 44.896 ms 2 - 6 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 9.16 ms 2 - 6 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 9.803 ms 0 - 28 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® QCS8450 13.425 ms 3 - 296 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 10.734 ms 2 - 6 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 10.317 ms 24 - 24 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 101.568 ms 0 - 281 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 13.789 ms 3 - 260 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 4.925 ms 0 - 250 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 13.789 ms 3 - 260 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 4.874 ms 5 - 191 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 6.508 ms 5 - 187 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® X2 Elite 6.765 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® X Elite 12.044 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Gen 3 Mobile 8.339 ms 0 - 222 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Gen 1 Mobile 23.692 ms 5 - 254 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 19.177 ms 5 - 12 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.126 ms 5 - 7 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8775P 17.26 ms 1 - 180 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8650P 17.26 ms 1 - 180 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8255P 17.26 ms 1 - 180 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® QCS8450 23.692 ms 5 - 254 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 17.128 ms 7 - 14 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 12.044 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ Q-8750 6.508 ms 5 - 187 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA7255P 63.435 ms 0 - 179 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8295P 22.206 ms 0 - 209 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.24 ms 2 - 236 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 4.214 ms 0 - 231 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® X2 Elite 4.12 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® X Elite 9.467 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 5.82 ms 2 - 270 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 12.196 ms 2 - 273 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 34.607 ms 1 - 6 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 8.327 ms 1 - 6 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.771 ms 2 - 4 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8775P 9.033 ms 1 - 226 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8650P 9.033 ms 1 - 226 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8255P 9.033 ms 1 - 226 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® QCS8450 12.196 ms 2 - 273 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 8.75 ms 2 - 7 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 9.467 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 120.365 ms 2 - 263 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 14.501 ms 2 - 242 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 4.214 ms 0 - 231 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA7255P 21.061 ms 1 - 225 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8295P 12.372 ms 0 - 228 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 14.501 ms 2 - 242 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 4.598 ms 0 - 226 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 6.05 ms 0 - 219 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Gen 3 Mobile 8.074 ms 0 - 278 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Gen 1 Mobile 23.472 ms 0 - 304 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ IQ-8275 18.911 ms 0 - 58 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.877 ms 0 - 3 MB NPU
Yolo-v5 TFLITE float Qualcomm® QCS8450 23.472 ms 0 - 304 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ IQ-9075 16.857 ms 0 - 58 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ Q-8750 6.05 ms 0 - 219 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA7255P 62.988 ms 0 - 214 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8295P 21.581 ms 0 - 240 MB NPU

License

  • The license for the original implementation of Yolo-v5 can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support