lllyasviel commited on
Commit
43f85e2
1 Parent(s): 2c29b85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -1
README.md CHANGED
@@ -4,4 +4,75 @@ license: openrail
4
 
5
  This is the pretrained weights and some other detector weights of ControlNet.
6
 
7
- Some more details will be added to the model card in several days.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
 
5
  This is the pretrained weights and some other detector weights of ControlNet.
6
 
7
+ This is the pretrained weights and some other detector weights of ControlNet.
8
+
9
+ See also: https://github.com/lllyasviel/ControlNet
10
+
11
+ Descriptions of Files:
12
+
13
+ ControlNet/models/control_sd15_canny.pth
14
+
15
+ - The ControlNet+SD1.5 model to control SD using canny edge detection.
16
+
17
+ ControlNet/models/control_sd15_depth.pth
18
+
19
+ - The ControlNet+SD1.5 model to control SD using Midas depth estimation.
20
+
21
+ ControlNet/models/control_sd15_hed.pth
22
+
23
+ - The ControlNet+SD1.5 model to control SD using HED edge detection (soft edge).
24
+
25
+ ControlNet/models/control_sd15_mlsd.pth
26
+
27
+ - The ControlNet+SD1.5 model to control SD using M-LSD line detection (will also work with traditional Hough transform).
28
+
29
+ ControlNet/models/control_sd15_normal.pth
30
+
31
+ - The ControlNet+SD1.5 model to control SD using normal map. Best to use the normal map generated by that Gradio app. Other normal maps may also work as long as the direction is correct (left looks red, right looks blue, up looks green, down looks purple).
32
+
33
+ ControlNet/models/control_sd15_openpose.pth
34
+
35
+ - The ControlNet+SD1.5 model to control SD using OpenPose pose detection. Directly manipulating pose skeleton should also work.
36
+
37
+ ControlNet/models/control_sd15_scribble.pth
38
+
39
+ - The ControlNet+SD1.5 model to control SD using human scribbles. The model is trained with boundary edges with very strong data augmentation to simulate boundary lines similar to that drawn by human.
40
+
41
+ ControlNet/models/control_sd15_seg.pth
42
+
43
+ - The ControlNet+SD1.5 model to control SD using semantic segmentation. The protocol is ADE20k.
44
+
45
+ ControlNet/annotator/ckpts/body_pose_model.pth
46
+
47
+ - Third-party model: Openpose’s pose detection model.
48
+
49
+ ControlNet/annotator/ckpts/hand_pose_model.pth
50
+
51
+ - Third-party model: Openpose’s hand detection model.
52
+
53
+ ControlNet/annotator/ckpts/dpt_hybrid-midas-501f0c75.pt
54
+
55
+ - Third-party model: Midas depth estimation model.
56
+
57
+ ControlNet/annotator/ckpts/mlsd_large_512_fp32.pth
58
+
59
+ - Third-party model: M-LSD detection model.
60
+
61
+ ControlNet/annotator/ckpts/mlsd_tiny_512_fp32.pth
62
+
63
+ - Third-party model: M-LSD’s another smaller detection model (we do not use this one).
64
+
65
+ ControlNet/annotator/ckpts/network-bsds500.pth
66
+
67
+ - Third-party model: HED boundary detection.
68
+
69
+ ControlNet/annotator/ckpts/upernet_global_small.pth
70
+
71
+ - Third-party model: Uniformer semantic segmentation.
72
+
73
+ ControlNet/training/fill50k.zip
74
+
75
+ - The data for our training tutorial.
76
+
77
+
78
+