lihongjie commited on
Commit
def018b
·
1 Parent(s): c86f57f
.gitattributes CHANGED
@@ -37,3 +37,5 @@ models/rt_sceneflow.axmodel filter=lfs diff=lfs merge=lfs -text
37
  models/rt_sceneflow.onnx filter=lfs diff=lfs merge=lfs -text
38
  demo-imgs/im0.png filter=lfs diff=lfs merge=lfs -text
39
  demo-imgs/im1.png filter=lfs diff=lfs merge=lfs -text
 
 
 
37
  models/rt_sceneflow.onnx filter=lfs diff=lfs merge=lfs -text
38
  demo-imgs/im0.png filter=lfs diff=lfs merge=lfs -text
39
  demo-imgs/im1.png filter=lfs diff=lfs merge=lfs -text
40
+ AXModel-Disparity-Map-rt.png filter=lfs diff=lfs merge=lfs -text
41
+ ONNX-Disparity-Map-rt.png filter=lfs diff=lfs merge=lfs -text
AXModel-Disparity-Map-rt.png ADDED

Git LFS Details

  • SHA256: 4ac155a319ede459cc549f653ddebc59e9666949464916f9667a958ccfe44f2b
  • Pointer size: 131 Bytes
  • Size of remote file: 121 kB
ONNX-Disparity-Map-rt.png ADDED

Git LFS Details

  • SHA256: 4e0245da359f576b63f1495a31b7b1feea4d94376f1effd2cbbe6e5044883f7e
  • Pointer size: 131 Bytes
  • Size of remote file: 116 kB
README.md CHANGED
@@ -1,5 +1,75 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
3
  ---
4
 
5
- RT IGEV from https://github.com/gangweiX/IGEV-plusplus
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: bsd-3-clause
3
+ language:
4
+ - en
5
+ base_model:
6
+ - IGEV++
7
+ pipeline_tag: depth-estimation
8
+ tags:
9
+ - IGEV++
10
  ---
11
 
12
+ # IGEV++
13
+
14
+ This version of RT IGEV has been converted to run on the Axera NPU using **w8a16** quantization.
15
+
16
+ Compatible with Pulsar2 version: 5.0-patch1
17
+
18
+ ## Convert tools links:
19
+
20
+ For those who are interested in model conversion, you can try to export axmodel through
21
+
22
+ - [The repo of original](https://github.com/gangweiX/IGEV-plusplus)
23
+
24
+ - [Pulsar2 Link, How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html)
25
+
26
+
27
+ ## Support Platform
28
+
29
+ - AX650
30
+ - [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html)
31
+ - [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html)
32
+
33
+ |Chips|Models |Time|
34
+ |--|--|--|
35
+ |AX650|rt_sceneflow|210.0 ms |
36
+
37
+
38
+
39
+ ## How to use
40
+
41
+ Download all files from this repository to the device
42
+
43
+
44
+ ### python env requirement
45
+
46
+ #### pyaxengine
47
+
48
+ https://github.com/AXERA-TECH/pyaxengine
49
+
50
+ ```
51
+ wget https://github.com/AXERA-TECH/pyaxengine/releases/download/0.1.3.rc2/axengine-0.1.3-py3-none-any.whl
52
+ pip install axengine-0.1.3-py3-none-any.whl
53
+ ```
54
+
55
+ #### others
56
+
57
+ Maybe None.
58
+
59
+ #### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro)
60
+
61
+ Input image:
62
+
63
+ ![](samples/1_image.png)
64
+
65
+ run
66
+ ```
67
+ python3 infer_ax.py
68
+ ```
69
+
70
+ Output image:
71
+ ONNX result
72
+ ![](ONNX-Disparity-Map-rt.png)
73
+
74
+ AXmodel result
75
+ ![](AXModel-Disparity-Map-rt.png)