MysteryGuitarMan commited on
Commit
94dd666
1 Parent(s): c62e2df

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -3
README.md CHANGED
@@ -7,14 +7,24 @@ tags:
7
  # Control-LoRA Model Card
8
 
9
 
10
- ## Model
11
- Combining the power of ControlNet and low-rank parameter efficient fine tuning, we introduce Control-LoRAs.
12
 
13
- By integrating the strengths of both approaches, this offers a more efficient and compact method to bring model control for a wider variety of consumer GPUs.
 
 
 
 
14
 
15
  ### MiDaS and ClipDrop Depth
16
  ![canny](samples/depth-sample.jpeg)
17
 
 
 
 
 
 
 
18
  ### Canny Edge
19
  ![canny](samples/canny-sample.jpeg)
20
  Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.
 
7
  # Control-LoRA Model Card
8
 
9
 
10
+ ## Introduction
11
+ What's better than ControlNets for SDXL? ControlNet... but, more efficient.
12
 
13
+ By introducing low-rank parameter efficient fine tuning, we introduce ***Control-LoRAs***.
14
+
15
+ Integrating the strengths of both ControlNet and PEFT, this approach offers a more efficient and compact method to bring model control for a wider variety of consumer GPUs.
16
+
17
+ For each model below, you'll find `Rank 256` files (reducing the `~4.7GB` ControlNets to `~738MB`) and experimental, ultra-pruned `Rank 128` files (reducing to `~377MB`).
18
 
19
  ### MiDaS and ClipDrop Depth
20
  ![canny](samples/depth-sample.jpeg)
21
 
22
+ Depth estimation is an image processing technique that determines the distance of objects in a scene, providing a depth map that highlights variations in proximity.
23
+
24
+ In the example above, we compare the depth results of MiDaS dpt_beit_large_512 with ClipDrop Depth for portraits, and their subsequent use in Depth Control-LoRa.
25
+
26
+ The Control-LoRA utilizes a grayscale depth map for guided generation and has been trained on a diverse range of image concepts and aspect ratios.
27
+
28
  ### Canny Edge
29
  ![canny](samples/canny-sample.jpeg)
30
  Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.