RTMDet: Optimized for Qualcomm Devices

RTMDet is a highly efficient model for real-time object detection,capable of predicting both the bounding boxes and classes of objects within an image.It is highly optimized for real-time applications, making it reliable for industrial and commercial use

This is based on the implementation of RTMDet found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for RTMDet on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Input resolution: 640x640
  • Model checkpoint: RTMDet Medium
  • Model size (float): 105 MB
  • Number of parameters: 27.5M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
RTMDet ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 7.08 ms 1 - 185 MB NPU
RTMDet ONNX float Snapdragon® 8 Elite For Galaxy Mobile 9.496 ms 0 - 182 MB NPU
RTMDet ONNX float Snapdragon® X2 Elite 9.069 ms 5 - 5 MB NPU
RTMDet ONNX float Snapdragon® X Elite 17.018 ms 51 - 51 MB NPU
RTMDet ONNX float Snapdragon® 8 Gen 3 Mobile 12.274 ms 2 - 226 MB NPU
RTMDet ONNX float Snapdragon® 8 Gen 1 Mobile 31.819 ms 1 - 291 MB NPU
RTMDet ONNX float Qualcomm® Dragonwing™ IQ-8275 27.361 ms 5 - 13 MB NPU
RTMDet ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 16.522 ms 5 - 237 MB NPU
RTMDet ONNX float Qualcomm® QCS8450 31.819 ms 1 - 291 MB NPU
RTMDet ONNX float Qualcomm® Dragonwing™ IQ-9075 24.872 ms 5 - 13 MB NPU
RTMDet ONNX float Qualcomm® Dragonwing™ IQ-X7181 17.018 ms 51 - 51 MB NPU
RTMDet ONNX float Qualcomm® Dragonwing™ Q-8750 9.496 ms 0 - 182 MB NPU
RTMDet ONNX float Snapdragon® 8 Elite Extreme Gen 6 Mobile 6.358 ms 5 - 189 MB NPU
RTMDet ONNX float Snapdragon® 8 Elite Gen 6 Mobile 6.902 ms 1 - 177 MB NPU
RTMDet ONNX w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.878 ms 0 - 317 MB NPU
RTMDet ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 7.167 ms 0 - 293 MB NPU
RTMDet ONNX w8a16 Snapdragon® X2 Elite 6.625 ms 2 - 2 MB NPU
RTMDet ONNX w8a16 Snapdragon® X Elite 15.342 ms 27 - 27 MB NPU
RTMDet ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 12.292 ms 3 - 349 MB NPU
RTMDet ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 19.503 ms 3 - 351 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 53.914 ms 24 - 27 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 14.013 ms 2 - 7 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 14.83 ms 2 - 6 MB NPU
RTMDet ONNX w8a16 Qualcomm® QCS8450 19.503 ms 3 - 351 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 15.416 ms 2 - 6 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 15.342 ms 27 - 27 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 139.097 ms 15 - 325 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 22.502 ms 25 - 320 MB NPU
RTMDet ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 7.167 ms 0 - 293 MB NPU
RTMDet ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 22.502 ms 25 - 320 MB NPU
RTMDet ONNX w8a16 Snapdragon® 8 Elite Extreme Gen 6 Mobile 4.119 ms 3 - 298 MB NPU
RTMDet ONNX w8a16 Snapdragon® 8 Elite Gen 6 Mobile 5.992 ms 3 - 273 MB NPU
RTMDet TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 6.887 ms 8 - 218 MB NPU
RTMDet TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 8.902 ms 8 - 212 MB NPU
RTMDet TFLITE float Snapdragon® 8 Gen 3 Mobile 11.907 ms 9 - 287 MB NPU
RTMDet TFLITE float Snapdragon® 8 Gen 1 Mobile 39.579 ms 10 - 355 MB NPU
RTMDet TFLITE float Qualcomm® Dragonwing™ IQ-8275 27.503 ms 9 - 82 MB NPU
RTMDet TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 15.816 ms 9 - 12 MB NPU
RTMDet TFLITE float Qualcomm® SA8775P 24.201 ms 9 - 212 MB NPU
RTMDet TFLITE float Qualcomm® SA8650P 24.201 ms 9 - 212 MB NPU
RTMDet TFLITE float Qualcomm® SA8255P 24.201 ms 9 - 212 MB NPU
RTMDet TFLITE float Qualcomm® QCS8450 39.579 ms 10 - 355 MB NPU
RTMDet TFLITE float Qualcomm® Dragonwing™ IQ-9075 24.698 ms 8 - 79 MB NPU
RTMDet TFLITE float Qualcomm® Dragonwing™ Q-8750 8.902 ms 8 - 212 MB NPU
RTMDet TFLITE float Qualcomm® SA8295P 32.716 ms 9 - 274 MB NPU
RTMDet TFLITE float Snapdragon® 8 Elite Extreme Gen 6 Mobile 6.2 ms 8 - 218 MB NPU
RTMDet TFLITE float Snapdragon® 8 Elite Gen 6 Mobile 6.775 ms 8 - 218 MB NPU

License

  • The license for the original implementation of RTMDet can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support