File size: 1,305 Bytes
3304492
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34e7c7d
 
3304492
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
---
license: apache-2.0
library_name: diffusers
---
test under this PR https://github.com/huggingface/diffusers/pull/11235

```python
from diffusers.modular_pipelines import ModularPipelineMixin, ComponentsManager
import torch
from diffusers.utils import load_image

repo_id = "YiYiXu/modular-diffdiff"

diffdiff_blocks = ModularPipelineMixin.from_pretrained(repo_id, trust_remote_code=True)
components = ComponentsManager()

diffdiff_blocks.setup_loader(modular_repo=repo_id, component_manager=components, collection="diffdiff")
diffdiff_blocks.loader.load(torch_dtype=torch.float16)

components.enable_auto_cpu_offload()



image = load_image( "https://huggingface.co/datasets/OzzyGT/testing-resources/resolve/main/differential/20240329211129_4024911930.png?download=true")
mask = load_image("https://huggingface.co/datasets/OzzyGT/testing-resources/resolve/main/differential/gradient_mask.png?download=true")

prompt = "a green pear"
negative_prompt = "blurry"

image = diffdiff_blocks.run(
    prompt=prompt,
    negative_prompt=negative_prompt,
    num_inference_steps=25,
    diffdiff_map=mask,
    image=image,
    output="images"
)[0]

image.save("yiyi_test_10_out.png")
```


![image/png](https://cdn-uploads.huggingface.co/production/uploads/624ef9ba9d608e459387b34e/4zqJOz-35Q0i6jyUW3liL.png)