eliphatfs commited on
Commit
60f23e6
1 Parent(s): ffc566a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -0
README.md CHANGED
@@ -1,3 +1,47 @@
1
  ---
2
  license: mit
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ metrics:
4
+ - accuracy
5
  ---
6
+
7
+ # OpenShape Inference Library
8
+
9
+ ## Installation
10
+
11
+ First, you have to install a recent version of [torch](//pytorch.org/get-started/locally/) and [dgl](//www.dgl.ai/pages/start.html).
12
+
13
+ Then install the following extra dependencies:
14
+ ```bash
15
+ pip install torch.redstone einops huggingface_hub
16
+ ```
17
+
18
+ Finally, install OpenShape by cloning the repository and running
19
+ ```bash
20
+ pip install -e .
21
+ ```
22
+
23
+ ## Usage
24
+
25
+ ### Loading an OpenShape model
26
+
27
+ ```python
28
+ import openshape
29
+ pc_encoder = openshape.load_pc_encoder('openshape-pointbert-vitg14-rgb')
30
+
31
+ # Available models:
32
+ # openshape-pointbert-vitb32-rgb, trained against CLIP ViT-B/32
33
+ # openshape-pointbert-vitl14-rgb, trained against CLIP ViT-L/14
34
+ # openshape-pointbert-vitg14-rgb, trained against OpenCLIP ViT-bigG/14 (main model in paper)
35
+ ```
36
+
37
+ Models accept point clouds of shape [B, 6, N] (XYZ-RGB) and trained with N = 10000.
38
+
39
+ Point clouds should be centered at centroid and normalized into the unit ball, and RGB values should have range [0, 1].
40
+ If you don't have RGB available in your point cloud, fill with [0.4, 0.4, 0.4].
41
+
42
+ **Note:** B/32 and L/14 models has gravity axis Y; G/14 model has gravity axis Z.
43
+
44
+ ### Applications
45
+
46
+ Various downstream applications can be found in the demo directory.
47
+ Check the code at https://huggingface.co/spaces/OpenShape/openshape-demo/tree/main for usage.