ghoskno commited on
Commit
7149fba
1 Parent(s): f036335

update: readme about accelerate detail

Browse files
Files changed (1) hide show
  1. app.py +10 -1
app.py CHANGED
@@ -146,7 +146,16 @@ with block:
146
  This allows generated images to maintain the same color composition as the original images. If you are looking to control both the contours and colors of the original image while using ControlNet to generate images, then this is the best option for you! You can try out this model or test the examples provided below 🤗.
147
 
148
  ## Update
149
- Hi, everyone, We have added a Color-Canny-ControlNet accelerated version of our implementation based on Nvidia Triton and operator optimization. This faster ControlNet is deployed on a Nvidia A10 machine, and for a 512-pixel image, the inference takes about 1.2s, which is more faster than general implementation.
 
 
 
 
 
 
 
 
 
150
  Welcome to try this [faster Color-Canny-ControlNet](http://121.40.118.209:7860/).
151
  """)
152
  with gr.Row():
 
146
  This allows generated images to maintain the same color composition as the original images. If you are looking to control both the contours and colors of the original image while using ControlNet to generate images, then this is the best option for you! You can try out this model or test the examples provided below 🤗.
147
 
148
  ## Update
149
+ Hi, everyone, We have added a Color-Canny-ControlNet accelerated version of our implementation based on Nvidia Triton and operator optimization. This faster ControlNet is deployed on a Nvidia A10 machine. For a 512-pixel image, the inference takes about 1.2s, which is more faster than general implementation with accelerate PyTorch2.0 about 40%.
150
+ We provide detailed test results as shown below.
151
+
152
+ | Method | Infomation | Inference Times | Speed-up Ratio |
153
+ | --------------------- | --------------------- | --------------------- | -------------- |
154
+ | Benchmark | [Huggingface implement](https://huggingface.co/blog/controlnet?spm=ata.21736010.0.0.422d24288Kj7zm) | 3.00s(V100)/5.00s(T4) | / |
155
+ | Accelerate PyTorch2.0 | xFormers | 2.03s(A10) | 0 |
156
+ | | SDPA | 2.02s(A10) | 0.5% |
157
+ | Ours | TRT & OP optimize | 1.20s(A10) | 40.4% |
158
+
159
  Welcome to try this [faster Color-Canny-ControlNet](http://121.40.118.209:7860/).
160
  """)
161
  with gr.Row():