wangqixun commited on
Commit
9679822
·
verified ·
1 Parent(s): f15f8f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -8
README.md CHANGED
@@ -18,22 +18,26 @@ base_model: black-forest-labs/FLUX.1-dev
18
  <img src="./images/image_union.png" width = "1000" />
19
 
20
 
21
- ## Diffusers version
22
-
23
- Until the next Diffusers pypi release, please install Diffusers from source and use [this PR(update 2024.08.20)](https://github.com/huggingface/diffusers/pull/9175) to be able to use.
24
- TODO: change when new version.
25
 
 
 
 
26
  Before merging into the official main branch of diffusers, you can use this [diffusers_flux](https://github.com/instantX-research/diffusers_flux).
27
 
 
 
 
 
28
 
29
 
30
  ## Checkpoint
31
 
32
  The training of union controlnet requires a significant amount of computational power.
33
- The current release is only an alpha version checkpoint that has not been fully trained.
34
- The beta version is in the training process.
35
  We have conducted ablation studies that have demonstrated the validity of the code.
36
- The open-source release of the alpha version is solely to facilitate the rapid growth of the open-source community and the Flux ecosystem;
37
  it is common to encounter bad cases (please accept my apologies).
38
  It is worth noting that we have found that even a fully trained Union model may not perform as well as specialized models, such as pose control.
39
  However, as training progresses, the performance of the Union model will continue to approach that of specialized models.
@@ -63,7 +67,7 @@ from diffusers.models.controlnet_flux import FluxControlNetModel
63
 
64
  # load
65
  base_model = 'black-forest-labs/FLUX.1-dev'
66
- controlnet_model = 'InstantX/FLUX.1-dev-Controlnet-Union-alpha'
67
  controlnet = FluxControlNetModel.from_pretrained(controlnet_model, torch_dtype=torch.bfloat16)
68
  pipe = FluxControlNetPipeline.from_pretrained(base_model, controlnet=controlnet, torch_dtype=torch.bfloat16)
69
  pipe.to("cuda")
 
18
  <img src="./images/image_union.png" width = "1000" />
19
 
20
 
21
+ ## Release
 
 
 
22
 
23
+ - [2024/08/20] 🔥 Release the first beta version.
24
+ Until the next Diffusers pypi release,
25
+ please install Diffusers from source and use [this PR](https://github.com/huggingface/diffusers/pull/9175) to be able to use.
26
  Before merging into the official main branch of diffusers, you can use this [diffusers_flux](https://github.com/instantX-research/diffusers_flux).
27
 
28
+ - [2024/08/14] Release the alpha version.
29
+
30
+
31
+
32
 
33
 
34
  ## Checkpoint
35
 
36
  The training of union controlnet requires a significant amount of computational power.
37
+ The current release is the first beta version checkpoint that maybe not been fully trained.
38
+ The fully trainedbeta version is in the training process.
39
  We have conducted ablation studies that have demonstrated the validity of the code.
40
+ The open-source release of the first beta version is solely to facilitate the rapid growth of the open-source community and the Flux ecosystem;
41
  it is common to encounter bad cases (please accept my apologies).
42
  It is worth noting that we have found that even a fully trained Union model may not perform as well as specialized models, such as pose control.
43
  However, as training progresses, the performance of the Union model will continue to approach that of specialized models.
 
67
 
68
  # load
69
  base_model = 'black-forest-labs/FLUX.1-dev'
70
+ controlnet_model = 'InstantX/FLUX.1-dev-Controlnet-Union'
71
  controlnet = FluxControlNetModel.from_pretrained(controlnet_model, torch_dtype=torch.bfloat16)
72
  pipe = FluxControlNetPipeline.from_pretrained(base_model, controlnet=controlnet, torch_dtype=torch.bfloat16)
73
  pipe.to("cuda")