qaihm-bot commited on
Commit
29623da
·
verified ·
1 Parent(s): 4e3f255

See https://github.com/qualcomm/ai-hub-models/releases/v0.53.1 for changelog.

Files changed (3) hide show
  1. LICENSE +1 -0
  2. README.md +96 -0
  3. release_assets.json +23 -0
LICENSE ADDED
@@ -0,0 +1 @@
 
 
1
+ The license of the original trained model can be found at https://github.com/PRBonn/lidar-bonnetal/blob/master/LICENSE.
README.md ADDED
@@ -0,0 +1,96 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ license: other
4
+ tags:
5
+ - real_time
6
+ - bu_auto
7
+ - android
8
+ pipeline_tag: other
9
+
10
+ ---
11
+
12
+ ![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/rangenet_plus_plus/web-assets/model_demo.png)
13
+
14
+ # RangeNet-Plus-Plus: Optimized for Qualcomm Devices
15
+
16
+ RangeNet-Plus-Plus (also stylized as RangeNet++) projects a LiDAR point cloud onto a 5-channel range image (depth, x, y, z, intensity) and applies a DarkNet-53 encoder with a decoder head to predict per-point semantic class labels in real time.
17
+
18
+ This is based on the implementation of RangeNet-Plus-Plus found [here](https://github.com/PRBonn/lidar-bonnetal).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/rangenet_plus_plus) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
+
21
+ Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
+
23
+ ## Getting Started
24
+ There are two ways to deploy this model on your device:
25
+
26
+ ### Option 1: Download Pre-Exported Models
27
+
28
+ Below are pre-exported model assets ready for deployment.
29
+
30
+ | Runtime | Precision | Chipset | SDK Versions | Download |
31
+ |---|---|---|---|---|
32
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/rangenet_plus_plus/releases/v0.53.1/rangenet_plus_plus-onnx-float.zip)
33
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/rangenet_plus_plus/releases/v0.53.1/rangenet_plus_plus-tflite-float.zip)
34
+
35
+ For more device-specific assets and performance metrics, visit **[RangeNet-Plus-Plus on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/rangenet_plus_plus)**.
36
+
37
+
38
+ ### Option 2: Export with Custom Configurations
39
+
40
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/rangenet_plus_plus) Python library to compile and export the model with your own:
41
+ - Custom weights (e.g., fine-tuned checkpoints)
42
+ - Custom input shapes
43
+ - Target device and runtime configurations
44
+
45
+ This option is ideal if you need to customize the model beyond the default configuration provided here.
46
+
47
+ See our repository for [RangeNet-Plus-Plus on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/rangenet_plus_plus) for usage instructions.
48
+
49
+ ## Model Details
50
+
51
+ **Model Type:** Model_use_case.driver_assistance
52
+
53
+ **Model Stats:**
54
+ - Model checkpoint: darknet53_rangenet++
55
+ - Input resolution: 64x2048
56
+ - Input channels: 5
57
+ - Number of output classes: 20
58
+ - Backbone: DarkNet-53
59
+
60
+ ## Performance Summary
61
+ | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
62
+ |---|---|---|---|---|---|---
63
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 41.39 ms | 3 - 335 MB | NPU
64
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® 8 Elite Mobile | 58.534 ms | 0 - 329 MB | NPU
65
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® X2 Elite | 49.501 ms | 101 - 101 MB | NPU
66
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® X Elite | 100.677 ms | 100 - 100 MB | NPU
67
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® X Elite | 100.677 ms | 100 - 100 MB | NPU
68
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 74.569 ms | 0 - 457 MB | NPU
69
+ | RangeNet-Plus-Plus | ONNX | float | Qualcomm® QCS8550 (Proxy) | 102.668 ms | 3 - 5 MB | NPU
70
+ | RangeNet-Plus-Plus | ONNX | float | Qualcomm® QCS9075 | 159.07 ms | 2 - 8 MB | NPU
71
+ | RangeNet-Plus-Plus | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 58.534 ms | 0 - 329 MB | NPU
72
+ | RangeNet-Plus-Plus | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 44.421 ms | 0 - 315 MB | NPU
73
+ | RangeNet-Plus-Plus | TFLITE | float | Snapdragon® 8 Elite Mobile | 60.235 ms | 0 - 296 MB | NPU
74
+ | RangeNet-Plus-Plus | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 78.37 ms | 0 - 511 MB | NPU
75
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 595.836 ms | 0 - 308 MB | NPU
76
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 97.484 ms | 0 - 96 MB | NPU
77
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® SA8775P | 154.76 ms | 0 - 308 MB | NPU
78
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® SA8775P | 154.76 ms | 0 - 308 MB | NPU
79
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® SA8775P | 154.76 ms | 0 - 308 MB | NPU
80
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® QCS9075 | 167.36 ms | 0 - 107 MB | NPU
81
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 195.519 ms | 1 - 500 MB | NPU
82
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® SA7255P | 595.836 ms | 0 - 308 MB | NPU
83
+ | RangeNet-Plus-Plus | TFLITE | float | Qualcomm® SA8295P | 171.967 ms | 0 - 302 MB | NPU
84
+ | RangeNet-Plus-Plus | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 60.235 ms | 0 - 296 MB | NPU
85
+
86
+ ## License
87
+ * The license for the original implementation of RangeNet-Plus-Plus can be found
88
+ [here](https://github.com/PRBonn/lidar-bonnetal/blob/master/LICENSE).
89
+
90
+ ## References
91
+ * [RangeNet++: Fast and Accurate LiDAR Semantic Segmentation](https://ieeexplore.ieee.org/document/8967762)
92
+ * [Source Model Implementation](https://github.com/PRBonn/lidar-bonnetal)
93
+
94
+ ## Community
95
+ * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
96
+ * For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).
release_assets.json ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "0.53.1",
3
+ "precisions": {
4
+ "float": {
5
+ "universal_assets": {
6
+ "tflite": {
7
+ "tool_versions": {
8
+ "qairt": "2.45.0.260326154327",
9
+ "litert": "1.4.3"
10
+ },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/rangenet_plus_plus/releases/v0.53.1/rangenet_plus_plus-tflite-float.zip"
12
+ },
13
+ "onnx": {
14
+ "tool_versions": {
15
+ "qairt": "2.42.0.251225135753_193295",
16
+ "onnx_runtime": "1.24.3"
17
+ },
18
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/rangenet_plus_plus/releases/v0.53.1/rangenet_plus_plus-onnx-float.zip"
19
+ }
20
+ }
21
+ }
22
+ }
23
+ }