takuma104
/

controlnet_dev

Model card Files Files and versions Community

takuma104 commited on Feb 25, 2023

Commit

8f04768

•

1 Parent(s): 25aa3fe

update prompt

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

gen_compare/.gitattributes +2 -0
gen_compare/README.md +5 -3
gen_compare/gen_diffusers_image.py +2 -2
gen_compare/gen_reference_image.py +2 -2
gen_compare/output_images/diffusers/output_bird_canny_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_canny_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_canny_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_canny_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_depth_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_depth_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_depth_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_depth_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_hed_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_hed_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_hed_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_hed_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_mlsd_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_mlsd_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_mlsd_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_mlsd_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_normal_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_normal_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_normal_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_normal_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_openpose_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_openpose_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_openpose_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_openpose_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_scribble_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_scribble_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_scribble_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_scribble_3.png +3 -0
gen_compare/output_images/diffusers/output_bird_seg_0.png +3 -0
gen_compare/output_images/diffusers/output_bird_seg_1.png +3 -0
gen_compare/output_images/diffusers/output_bird_seg_2.png +3 -0
gen_compare/output_images/diffusers/output_bird_seg_3.png +3 -0
gen_compare/output_images/diffusers/output_human_canny_0.png +3 -0
gen_compare/output_images/diffusers/output_human_canny_1.png +3 -0
gen_compare/output_images/diffusers/output_human_canny_2.png +3 -0
gen_compare/output_images/diffusers/output_human_canny_3.png +3 -0
gen_compare/output_images/diffusers/output_human_depth_0.png +3 -0
gen_compare/output_images/diffusers/output_human_depth_1.png +3 -0
gen_compare/output_images/diffusers/output_human_depth_2.png +3 -0
gen_compare/output_images/diffusers/output_human_depth_3.png +3 -0
gen_compare/output_images/diffusers/output_human_hed_0.png +3 -0
gen_compare/output_images/diffusers/output_human_hed_1.png +3 -0
gen_compare/output_images/diffusers/output_human_hed_2.png +3 -0
gen_compare/output_images/diffusers/output_human_hed_3.png +3 -0
gen_compare/output_images/diffusers/output_human_mlsd_0.png +3 -0
gen_compare/output_images/diffusers/output_human_mlsd_1.png +3 -0

gen_compare/.gitattributes CHANGED Viewed

@@ -10,3 +10,5 @@ control_images/bird_512x512.png filter=lfs diff=lfs merge=lfs -text
 control_images/human_512x512.png filter=lfs diff=lfs merge=lfs -text
 control_images/room_512x512.png filter=lfs diff=lfs merge=lfs -text
 control_images/vermeer_512x512.png filter=lfs diff=lfs merge=lfs -text

 control_images/human_512x512.png filter=lfs diff=lfs merge=lfs -text
 control_images/room_512x512.png filter=lfs diff=lfs merge=lfs -text
 control_images/vermeer_512x512.png filter=lfs diff=lfs merge=lfs -text
+output_images/diffusers/*.png filter=lfs diff=lfs merge=lfs -text
+output_images/ref/*.png filter=lfs diff=lfs merge=lfs -text

gen_compare/README.md CHANGED Viewed

@@ -6,7 +6,9 @@
 ## Environment
 - OS: Ubuntu 22.04
-- GPU: Nvidia RTX3060 (12GB)
 ## Scripts to generate plots:
 - Create control image: [create_control_images.py](create_control_images.py)
@@ -30,8 +32,8 @@ Converted above original images by [controlnet_hinter](https://github.com/takuma
 #### Prompts:
 All images were generated with the same prompt.
-- Prompt: `best quality, extremely detailed, illustration, looking at viewer`
-- Negative Prompt: `monochrome, lowres, bad anatomy, worst quality, low quality`
 #### Ohter setting (both common):
 - sampler: DDIM

 ## Environment
 - OS: Ubuntu 22.04
+- GPU: Nvidia RTX3060
+- Cuda: 11.7
+- Pytorch: 1.13.1
 ## Scripts to generate plots:
 - Create control image: [create_control_images.py](create_control_images.py)
 #### Prompts:
 All images were generated with the same prompt.
+- Prompt: `best quality, extremely detailed`
+- Negative Prompt: `lowres, bad anatomy, worst quality, low quality`
 #### Ohter setting (both common):
 - sampler: DDIM

gen_compare/gen_diffusers_image.py CHANGED Viewed

@@ -10,8 +10,8 @@ from diffusers import StableDiffusionControlNetPipeline
 from PIL import Image
-test_prompt = "best quality, extremely detailed, illustration, looking at viewer"
-test_negative_prompt = "monochrome, lowres, bad anatomy, worst quality, low quality"
 def generate_image(seed, control):
     latent = torch.randn((1,4,64,64), device="cpu", generator=torch.Generator(device="cpu").manual_seed(seed)).cuda()

 from PIL import Image
+test_prompt = "best quality, extremely detailed"
+test_negative_prompt = "lowres, bad anatomy, worst quality, low quality"
 def generate_image(seed, control):
     latent = torch.randn((1,4,64,64), device="cpu", generator=torch.Generator(device="cpu").manual_seed(seed)).cuda()

gen_compare/gen_reference_image.py CHANGED Viewed

@@ -13,8 +13,8 @@ from cldm.model import create_model, load_state_dict
 from ldm.models.diffusion.ddim import DDIMSampler
 from diffusers.utils import load_image
-test_prompt = "best quality, extremely detailed, illustration, looking at viewer"
-test_negative_prompt = "monochrome, lowres, bad anatomy, worst quality, low quality"
 @torch.no_grad()
 def generate(prompt, n_prompt, seed, control, ddim_steps=20, eta=0.0, scale=9.0, H=512, W=512):

 from ldm.models.diffusion.ddim import DDIMSampler
 from diffusers.utils import load_image
+test_prompt = "best quality, extremely detailed"
+test_negative_prompt = "lowres, bad anatomy, worst quality, low quality"
 @torch.no_grad()
 def generate(prompt, n_prompt, seed, control, ddim_steps=20, eta=0.0, scale=9.0, H=512, W=512):

gen_compare/output_images/diffusers/output_bird_canny_0.png ADDED Viewed

Git LFS Details

SHA256: c2f1eb8d747a9ad62304b118d06b17e7c6c43ca2d2708ed3a5e7d2f74b59258a
Pointer size: 131 Bytes
Size of remote file: 504 kB

gen_compare/output_images/diffusers/output_bird_canny_1.png ADDED Viewed

Git LFS Details

SHA256: 49cfbb52f335e60698fa1ab125d4187939875fc72d4bc1c34bf3cad569c674e4
Pointer size: 131 Bytes
Size of remote file: 482 kB

gen_compare/output_images/diffusers/output_bird_canny_2.png ADDED Viewed

Git LFS Details

SHA256: 7539dc71762898e03bc2bf2ad045bcc7ac927d1d2b849de504aa494acca7d767
Pointer size: 131 Bytes
Size of remote file: 423 kB

gen_compare/output_images/diffusers/output_bird_canny_3.png ADDED Viewed

Git LFS Details

SHA256: c3792588d3186ca8e2d0fe279f388b2f23fa8d2b5e7243415907202b9dcaf29b
Pointer size: 131 Bytes
Size of remote file: 551 kB

gen_compare/output_images/diffusers/output_bird_depth_0.png ADDED Viewed

Git LFS Details

SHA256: b3170fd58645dd6b68f8b2412fb7a874e1a6e5602cf3334d83553f0c5ac9e272
Pointer size: 131 Bytes
Size of remote file: 606 kB

gen_compare/output_images/diffusers/output_bird_depth_1.png ADDED Viewed

Git LFS Details

SHA256: 19489aa2f9f21acf1b91b3aedbeb600b341f2e2ef7f57a42651b5dfeff33af75
Pointer size: 131 Bytes
Size of remote file: 494 kB

gen_compare/output_images/diffusers/output_bird_depth_2.png ADDED Viewed

Git LFS Details

SHA256: 6c22f877e90d87b400f63f3911ef3e28c28eb9abfbc62d192e26fc57ff2325e4
Pointer size: 131 Bytes
Size of remote file: 449 kB

gen_compare/output_images/diffusers/output_bird_depth_3.png ADDED Viewed

Git LFS Details

SHA256: a164a265597a2032a13325066b901a5a62e9e0cf1535a3758dc4d2a0e5311dbd
Pointer size: 131 Bytes
Size of remote file: 560 kB

gen_compare/output_images/diffusers/output_bird_hed_0.png ADDED Viewed

Git LFS Details

SHA256: 4db19236825084b3afcd648f73331853b529abc0b3c3a80dcc8a3cc028fb3c19
Pointer size: 131 Bytes
Size of remote file: 605 kB

gen_compare/output_images/diffusers/output_bird_hed_1.png ADDED Viewed

Git LFS Details

SHA256: 8a11c4432ee4989ca47dd73e74ba0bc6308674d36a15f21fbba95fadfb23803d
Pointer size: 131 Bytes
Size of remote file: 555 kB

gen_compare/output_images/diffusers/output_bird_hed_2.png ADDED Viewed

Git LFS Details

SHA256: 8b8f29956f5f7ebe042e26751fda9d3a402eed0c739f56eb7f595cd0a2bdb1ff
Pointer size: 131 Bytes
Size of remote file: 498 kB

gen_compare/output_images/diffusers/output_bird_hed_3.png ADDED Viewed

Git LFS Details

SHA256: 89d58cfb313a49f343a5ed80469899c382ff76bf8b6b63f6d6b1fae034c604f4
Pointer size: 131 Bytes
Size of remote file: 603 kB

gen_compare/output_images/diffusers/output_bird_mlsd_0.png ADDED Viewed

Git LFS Details

SHA256: 60cd7d15d23e083808fb4f674a5cfcbe6e8a4bce265834c74bf58d458b4fbd39
Pointer size: 131 Bytes
Size of remote file: 566 kB

gen_compare/output_images/diffusers/output_bird_mlsd_1.png ADDED Viewed

Git LFS Details

SHA256: b32a468c30ac6ce314c660f390faf77a3aa725f27a1bfde4445fcbdd8ec4db96
Pointer size: 131 Bytes
Size of remote file: 568 kB

gen_compare/output_images/diffusers/output_bird_mlsd_2.png ADDED Viewed

Git LFS Details

SHA256: e88a05775800d4bf20247594c4a9446963356702f66bec7e1a5abc79e53204cc
Pointer size: 131 Bytes
Size of remote file: 485 kB

gen_compare/output_images/diffusers/output_bird_mlsd_3.png ADDED Viewed

Git LFS Details

SHA256: ba3bf289bb2dded691dfa590c3d61735fc168429f0d4bad35b590258a7a589b3
Pointer size: 131 Bytes
Size of remote file: 572 kB

gen_compare/output_images/diffusers/output_bird_normal_0.png ADDED Viewed

Git LFS Details

SHA256: ffbc070e22462d9d4ded3af2f2596c3c5f17584c6791317e0a691dbafeb43426
Pointer size: 131 Bytes
Size of remote file: 540 kB

gen_compare/output_images/diffusers/output_bird_normal_1.png ADDED Viewed

Git LFS Details

SHA256: 4deb422ec0c8393afb7d55c297268f870d76feba6145618163d5d2cb023867a6
Pointer size: 131 Bytes
Size of remote file: 470 kB

gen_compare/output_images/diffusers/output_bird_normal_2.png ADDED Viewed

Git LFS Details

SHA256: ba50f970f009c02e27d5b36b539620e74c3d817f8eb70972d3bc57c86955e9b8
Pointer size: 131 Bytes
Size of remote file: 418 kB

gen_compare/output_images/diffusers/output_bird_normal_3.png ADDED Viewed

Git LFS Details

SHA256: a2e062bfb059de695799e118488a1cc98bc05c3d8181e81816ba919c23258258
Pointer size: 131 Bytes
Size of remote file: 557 kB

gen_compare/output_images/diffusers/output_bird_openpose_0.png ADDED Viewed

Git LFS Details

SHA256: 03e56abfd43d85da02351ca77f4324b9227463f38dbb60267eeb2e7d5b747010
Pointer size: 131 Bytes
Size of remote file: 521 kB

gen_compare/output_images/diffusers/output_bird_openpose_1.png ADDED Viewed

Git LFS Details

SHA256: fda33872577becef80e9af25dd3da0a92bde09db93dbbfa2a4f79e1db5b2fbdf
Pointer size: 131 Bytes
Size of remote file: 430 kB

gen_compare/output_images/diffusers/output_bird_openpose_2.png ADDED Viewed

Git LFS Details

SHA256: 9bceb15f7f6f7c936b95abd92b9e8a00fd20c3d0d2e485493d490130658a0967
Pointer size: 131 Bytes
Size of remote file: 435 kB

gen_compare/output_images/diffusers/output_bird_openpose_3.png ADDED Viewed

Git LFS Details

SHA256: 02cd6206b51408a925a8a8d2d9cca0601101b4c18068d737525ceb4f2246c7e1
Pointer size: 131 Bytes
Size of remote file: 541 kB

gen_compare/output_images/diffusers/output_bird_scribble_0.png ADDED Viewed

Git LFS Details

SHA256: a403351a1254e495c66cbe7d0b1eb7970cf497de8d91205a1cd4812802dec69a
Pointer size: 131 Bytes
Size of remote file: 609 kB

gen_compare/output_images/diffusers/output_bird_scribble_1.png ADDED Viewed

Git LFS Details

SHA256: 8252f4c9e7490647bd26435e6f7c88cd59ef0fbe1ab34d594cbd7f3dfbcdeb6a
Pointer size: 131 Bytes
Size of remote file: 554 kB

gen_compare/output_images/diffusers/output_bird_scribble_2.png ADDED Viewed

Git LFS Details

SHA256: dff1817919c2b627cd990289162158182185ed2802465bfce3fb43ebc9a3b6a0
Pointer size: 131 Bytes
Size of remote file: 481 kB

gen_compare/output_images/diffusers/output_bird_scribble_3.png ADDED Viewed

Git LFS Details

SHA256: 0887290748daae14fad34c7315f63646ae84342eef083959d550a34d28c0a193
Pointer size: 131 Bytes
Size of remote file: 565 kB

gen_compare/output_images/diffusers/output_bird_seg_0.png ADDED Viewed

Git LFS Details

SHA256: 60d1416bf65f395951754b8bdde91479569c5197ad61e3b70e6d12de81f01400
Pointer size: 131 Bytes
Size of remote file: 601 kB

gen_compare/output_images/diffusers/output_bird_seg_1.png ADDED Viewed

Git LFS Details

SHA256: 3379bf231292cbdccb98d8f870012709d215d0139243dd0066e40aa8db32d50a
Pointer size: 131 Bytes
Size of remote file: 546 kB

gen_compare/output_images/diffusers/output_bird_seg_2.png ADDED Viewed

Git LFS Details

SHA256: 7714fe83034ef0cd85c8625f40fc2e4d75e5d04828c9d2d84fcede2f67ba29e8
Pointer size: 131 Bytes
Size of remote file: 471 kB

gen_compare/output_images/diffusers/output_bird_seg_3.png ADDED Viewed

Git LFS Details

SHA256: 3a0c7beb0a1691ca62c35df621c4ed0d3cff2ab7d9e4d7c110ccfe18fc448229
Pointer size: 131 Bytes
Size of remote file: 598 kB

gen_compare/output_images/diffusers/output_human_canny_0.png ADDED Viewed

Git LFS Details

SHA256: 43e5a08e238083434106ac53a8e479c7e7e250d34166c6d4fd9eed49fce2c76b
Pointer size: 131 Bytes
Size of remote file: 469 kB

gen_compare/output_images/diffusers/output_human_canny_1.png ADDED Viewed

Git LFS Details

SHA256: e888e82b3b4e2261b260bacf76240bc1819fceb2d5a6c79914fdd0f30cdc386a
Pointer size: 131 Bytes
Size of remote file: 384 kB

gen_compare/output_images/diffusers/output_human_canny_2.png ADDED Viewed

Git LFS Details

SHA256: ef957d13f68df67b663a9f373ef67f5b90e016c9915affe04f7e6e5908b17e30
Pointer size: 131 Bytes
Size of remote file: 413 kB

gen_compare/output_images/diffusers/output_human_canny_3.png ADDED Viewed

Git LFS Details

SHA256: 668719b9c036f423b62fbafec8b60f625d64da107781515ea0b5421fc629ca7c
Pointer size: 131 Bytes
Size of remote file: 480 kB

gen_compare/output_images/diffusers/output_human_depth_0.png ADDED Viewed

Git LFS Details

SHA256: 8811bc96718dd8fbd09ad6a25a4abb1575d78189b9890995b81c1da67a65db12
Pointer size: 131 Bytes
Size of remote file: 480 kB

gen_compare/output_images/diffusers/output_human_depth_1.png ADDED Viewed

Git LFS Details

SHA256: d79a3b28d19a43861c1baf2e039fe180a5cf5ed4a50d4c9b8211e12f5021860a
Pointer size: 131 Bytes
Size of remote file: 389 kB

gen_compare/output_images/diffusers/output_human_depth_2.png ADDED Viewed

Git LFS Details

SHA256: d6e7309c28f4e6e83741a7fd8ccbeaa101d760dffc079011038aa9a903646d1c
Pointer size: 131 Bytes
Size of remote file: 458 kB

gen_compare/output_images/diffusers/output_human_depth_3.png ADDED Viewed

Git LFS Details

SHA256: efcad9a1fc7c7917df4e0bb37beaa493a4157bfcb2ace3d1d2efeafabab76259
Pointer size: 131 Bytes
Size of remote file: 492 kB

gen_compare/output_images/diffusers/output_human_hed_0.png ADDED Viewed

Git LFS Details

SHA256: 64fa25393a0a38b9d8e2fff1a640033fe24aa5f7d78065532af0524a5717d0dc
Pointer size: 131 Bytes
Size of remote file: 512 kB

gen_compare/output_images/diffusers/output_human_hed_1.png ADDED Viewed

Git LFS Details

SHA256: 4fb34e828c72e10cfe9f5ceaf37f708cc84815f84badcf3d77f29e0effa66398
Pointer size: 131 Bytes
Size of remote file: 446 kB

gen_compare/output_images/diffusers/output_human_hed_2.png ADDED Viewed

Git LFS Details

SHA256: 65291052876a3f7a0ba6ee3f4462bed280240e94e7dd98013c50f4d7e74cfefa
Pointer size: 131 Bytes
Size of remote file: 524 kB

gen_compare/output_images/diffusers/output_human_hed_3.png ADDED Viewed

Git LFS Details

SHA256: 7875798350abf706f75c29ea27403ad4c92b4303205c1c79f4d562bb70e91b0a
Pointer size: 131 Bytes
Size of remote file: 579 kB

gen_compare/output_images/diffusers/output_human_mlsd_0.png ADDED Viewed

Git LFS Details

SHA256: a1111a9f8f4c70745a239d4598398c501bac5b773c1b2178af20c75dc0fff42c
Pointer size: 131 Bytes
Size of remote file: 545 kB

gen_compare/output_images/diffusers/output_human_mlsd_1.png ADDED Viewed

Git LFS Details

SHA256: 21e3863c761b3b00d315feeb907727d859091800d8ee74300d337d925fd62c82
Pointer size: 131 Bytes
Size of remote file: 478 kB