Hugging Face's logo

qualcomm
/
Track-Anything

PyTorch
android
video-object-tracking
Model card Files
xet
 Community

YAML Metadata Warning:The pipeline tag "video-object-tracking" is not in the official list: text-classification, token-classification, table-question-answering, question-answering, zero-shot-classification, translation, summarization, feature-extraction, text-generation, fill-mask, sentence-similarity, text-to-speech, text-to-audio, automatic-speech-recognition, audio-to-audio, audio-classification, audio-text-to-text, voice-activity-detection, depth-estimation, image-classification, object-detection, image-segmentation, text-to-image, image-to-text, image-to-image, image-to-video, unconditional-image-generation, video-classification, reinforcement-learning, robotics, tabular-classification, tabular-regression, tabular-to-text, table-to-text, multiple-choice, text-ranking, text-retrieval, time-series-forecasting, text-to-video, image-text-to-text, image-text-to-image, image-text-to-video, visual-question-answering, document-question-answering, zero-shot-image-classification, graph-ml, mask-generation, zero-shot-object-detection, text-to-3d, image-to-3d, image-feature-extraction, video-text-to-text, keypoint-detection, visual-document-retrieval, any-to-any, video-to-video, other

Track-Anything: Optimized for Qualcomm Devices

Track-Anything is a video based machine learning model to track an object in a video.

This is based on the implementation of Track-Anything found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
TFLITE float Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit Track-Anything on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for Track-Anything on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.video_object_tracking

Model Stats:

  • Input resolution: 320x568
  • Model checkpoint: xmem
  • Model size (encode_key_with_shrinkage) (float): 37.1 MB
  • Model size (encode_key_without_shrinkage) (float): 37.1 MB
  • Model size (encode_value) (float): 88.8 MB
  • Model size (segment) (float): 115 MB
  • Number of parameters (encode_key_with_shrinkage): 9.72M
  • Number of parameters (encode_key_without_shrinkage): 9.71M
  • Number of parameters (encode_value): 23.3M
  • Number of parameters (segment): 30.1M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
encode_key_with_shrinkage ONNX float Snapdragon® X2 Elite 2.742 ms 10 - 10 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® X Elite 5.415 ms 19 - 19 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Gen 3 Mobile 3.697 ms 0 - 201 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Gen 1 Mobile 10.626 ms 9 - 190 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-8275 9.552 ms 8 - 11 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.162 ms 0 - 162 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® QCS8450 10.626 ms 9 - 190 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-9075 9.295 ms 10 - 13 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-X7181 5.415 ms 19 - 19 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ Q-8750 3.008 ms 1 - 170 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Elite Mobile 3.008 ms 1 - 170 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Elite Gen 5 Mobile 2.398 ms 1 - 173 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Gen 3 Mobile 4.064 ms 0 - 211 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Gen 1 Mobile 11.737 ms 3 - 199 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-8275 9.53 ms 3 - 31 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-8275 31.249 ms 3 - 179 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.96 ms 3 - 5 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8775P 9.483 ms 3 - 181 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8650P 9.483 ms 3 - 181 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8255P 9.483 ms 3 - 181 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® QCS8450 11.737 ms 3 - 199 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-9075 9.771 ms 2 - 29 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ Q-8750 3.285 ms 0 - 181 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA7255P 31.249 ms 3 - 179 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Elite Mobile 3.285 ms 0 - 181 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.461 ms 0 - 184 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® X2 Elite 3.864 ms 80 - 80 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® X Elite 6.673 ms 80 - 80 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Gen 3 Mobile 5.052 ms 53 - 255 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Gen 1 Mobile 13.509 ms 45 - 247 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-8275 11.61 ms 49 - 52 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.899 ms 35 - 54 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® QCS8450 13.509 ms 45 - 247 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-9075 11.308 ms 53 - 56 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-X7181 6.673 ms 80 - 80 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ Q-8750 4.366 ms 8 - 205 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Elite Mobile 4.366 ms 8 - 205 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.47 ms 1 - 181 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Gen 3 Mobile 5.51 ms 0 - 214 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Gen 1 Mobile 14.224 ms 20 - 224 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-8275 11.767 ms 20 - 64 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-8275 33.499 ms 20 - 205 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 7.914 ms 20 - 22 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8775P 11.655 ms 20 - 208 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8650P 11.655 ms 20 - 208 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8255P 11.655 ms 20 - 208 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® QCS8450 14.224 ms 20 - 224 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-9075 11.381 ms 20 - 63 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ Q-8750 4.402 ms 20 - 204 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA7255P 33.499 ms 20 - 205 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Elite Mobile 4.402 ms 20 - 204 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 3.584 ms 0 - 220 MB NPU
encode_value ONNX float Snapdragon® X2 Elite 6.557 ms 20 - 20 MB NPU
encode_value ONNX float Snapdragon® X Elite 13.456 ms 39 - 39 MB NPU
encode_value ONNX float Snapdragon® 8 Gen 3 Mobile 11.414 ms 0 - 210 MB NPU
encode_value ONNX float Snapdragon® 8 Gen 1 Mobile 31.654 ms 12 - 209 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ IQ-8275 18.766 ms 6 - 15 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 16.804 ms 0 - 44 MB NPU
encode_value ONNX float Qualcomm® QCS8450 31.654 ms 12 - 209 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ IQ-9075 18.828 ms 6 - 14 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ IQ-X7181 13.456 ms 39 - 39 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ Q-8750 9.552 ms 7 - 191 MB NPU
encode_value ONNX float Snapdragon® 8 Elite Mobile 9.552 ms 7 - 191 MB NPU
encode_value ONNX float Snapdragon® 8 Elite Gen 5 Mobile 8.207 ms 8 - 183 MB NPU
encode_value TFLITE float Snapdragon® 8 Gen 3 Mobile 8.226 ms 2 - 289 MB NPU
encode_value TFLITE float Snapdragon® 8 Gen 1 Mobile 21.33 ms 3 - 291 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ IQ-8275 18.139 ms 0 - 55 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ IQ-8275 51.335 ms 3 - 217 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.913 ms 3 - 6 MB NPU
encode_value TFLITE float Qualcomm® SA8775P 17.044 ms 3 - 215 MB NPU
encode_value TFLITE float Qualcomm® SA8650P 17.044 ms 3 - 215 MB NPU
encode_value TFLITE float Qualcomm® SA8255P 17.044 ms 3 - 215 MB NPU
encode_value TFLITE float Qualcomm® QCS8450 21.33 ms 3 - 291 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ IQ-9075 17.674 ms 0 - 55 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ Q-8750 6.836 ms 6 - 216 MB NPU
encode_value TFLITE float Qualcomm® SA7255P 51.335 ms 3 - 217 MB NPU
encode_value TFLITE float Snapdragon® 8 Elite Mobile 6.836 ms 6 - 216 MB NPU
encode_value TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 5.352 ms 3 - 203 MB NPU
segment ONNX float Snapdragon® X2 Elite 11.678 ms 21 - 21 MB NPU
segment ONNX float Snapdragon® X Elite 23.179 ms 38 - 38 MB NPU
segment ONNX float Snapdragon® 8 Gen 3 Mobile 17.395 ms 0 - 242 MB NPU
segment ONNX float Snapdragon® 8 Gen 1 Mobile 43.171 ms 16 - 246 MB NPU
segment ONNX float Qualcomm® Dragonwing™ IQ-8275 35.77 ms 21 - 46 MB NPU
segment ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.215 ms 0 - 45 MB NPU
segment ONNX float Qualcomm® QCS8450 43.171 ms 16 - 246 MB NPU
segment ONNX float Qualcomm® Dragonwing™ IQ-9075 34.47 ms 21 - 45 MB NPU
segment ONNX float Qualcomm® Dragonwing™ IQ-X7181 23.179 ms 38 - 38 MB NPU
segment ONNX float Qualcomm® Dragonwing™ Q-8750 13.384 ms 5 - 213 MB NPU
segment ONNX float Snapdragon® 8 Elite Mobile 13.384 ms 5 - 213 MB NPU
segment ONNX float Snapdragon® 8 Elite Gen 5 Mobile 10.83 ms 3 - 215 MB NPU
segment TFLITE float Snapdragon® 8 Gen 3 Mobile 17.44 ms 2 - 289 MB NPU
segment TFLITE float Snapdragon® 8 Gen 1 Mobile 42.288 ms 2 - 293 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ IQ-8275 35.509 ms 0 - 83 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ IQ-8275 103.383 ms 2 - 194 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.496 ms 2 - 4 MB NPU
segment TFLITE float Qualcomm® SA8775P 33.33 ms 2 - 194 MB NPU
segment TFLITE float Qualcomm® SA8650P 33.33 ms 2 - 194 MB NPU
segment TFLITE float Qualcomm® SA8255P 33.33 ms 2 - 194 MB NPU
segment TFLITE float Qualcomm® QCS8450 42.288 ms 2 - 293 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ IQ-9075 33.716 ms 0 - 83 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ Q-8750 13.144 ms 0 - 195 MB NPU
segment TFLITE float Qualcomm® SA7255P 103.383 ms 2 - 194 MB NPU
segment TFLITE float Snapdragon® 8 Elite Mobile 13.144 ms 0 - 195 MB NPU
segment TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 11.578 ms 2 - 200 MB NPU

License

  • The license for the original implementation of Track-Anything can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/Track-Anything