{ "cells": [ { "cell_type": "markdown", "id": "f06bea55-7889-4576-a83b-d3b207729e3d", "metadata": {}, "source": [ "# Controlnet 插件安装" ] }, { "cell_type": "markdown", "id": "9fab4ab6-be4b-4206-ba12-8dad73bac833", "metadata": {}, "source": [ "#### 更新日志\n", "\n", "- 安装Controlnet Canny(边缘检测)、Depth(深度检测)、Hed(边缘检测)、Openpose(提取人物骨骼姿势)、Openpose_hand(提取人物+手部骨骼)、\n", " ip2p(指令模型,变不同风格)、inpaint(图像修补)等模型\n", "- 安装上述模型需要的预处理器模型" ] }, { "cell_type": "markdown", "id": "39df08ff-45e4-4a86-add4-a5af9cc7f7d6", "metadata": {}, "source": [ "## 安装 Controlnet 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "567fe4a3-a897-48b6-bde2-0afb3d064c80", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 aria2下载软件\n", "!apt update\n", "!apt install -y aria2" ] }, { "cell_type": "code", "execution_count": null, "id": "8c290ca4-0880-41e1-b1c5-58fd9a755bb7", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 Canny(边缘检测)模型\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Control_1.1/resolve/main/control_v11p_sd15_canny.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models\")" ] }, { "cell_type": "code", "execution_count": null, "id": "ad32253f-3540-4917-a5ef-b501be9b978d", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 Depth(深度检测)模型\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Control_1.1/resolve/main/control_v11f1p_sd15_depth.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models\")" ] }, { "cell_type": "code", "execution_count": null, "id": "cb28e5ac-1bc0-4aa5-9000-3c43a935aa60", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 Openpose(提取人物骨骼姿势)模型\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Control_1.1/resolve/main/control_v11p_sd15_openpose.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models\")" ] }, { "cell_type": "code", "execution_count": null, "id": "274bdde6-acfd-462f-81c0-3e9d83eb32f0", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 ip2p(指令模型,变不同风格)模型\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Control_1.1/resolve/main/control_v11e_sd15_ip2p.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models\")" ] }, { "cell_type": "code", "execution_count": null, "id": "44cc3076-d1c9-4b4b-a2d3-0ad98191a698", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 inpaint(图像修补)模型\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Control_1.1/resolve/main/control_v11p_sd15_inpaint.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models\")" ] }, { "cell_type": "code", "execution_count": null, "id": "8ccfcdd1-ae77-4cf2-9e71-796b8766af2d", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 tile(放大图像)模型\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11f1e_sd15_tile.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models\")" ] }, { "cell_type": "markdown", "id": "383abdf0", "metadata": {}, "source": [ "## 安装 Controlnet 预处理器模型" ] }, { "cell_type": "code", "execution_count": null, "id": "fc03a411-c192-4913-9409-d14e099d8004", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 Controlnet 1.1 人物动作检测预处理模型.hand_pose_model.pht\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Controlnet_pt/resolve/main/hand_pose_model.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/openpose\")" ] }, { "cell_type": "code", "execution_count": null, "id": "30a616e9-3811-4101-8753-96719717eb1d", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 Controlnet 1.1 人物动作检测预处理模型.body_pose_model.pht\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Controlnet_pt/resolve/main/body_pose_model.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/openpose\")" ] }, { "cell_type": "code", "execution_count": null, "id": "e2a51fd2-a4f3-4d79-99cc-669b34324334", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 Controlnet 1.1 深度图预处理模型.dpt_hybrid-midas-501f0c75.pt\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/Controlnet_pt/resolve/main/dpt_hybrid-midas-501f0c75.pt\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/midas\")" ] }, { "cell_type": "markdown", "id": "48846277-f449-46ce-8dc9-60cbccec1d3f", "metadata": {}, "source": [ "## 图片预处理 处理器下载" ] }, { "cell_type": "code", "execution_count": null, "id": "73a6f4ae-e740-4452-88d0-8eee5d218861", "metadata": { "tags": [] }, "outputs": [], "source": [ "##安装 图片预处理 处理器下载 model-resnet_custom_v3.pt\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/model-resnet_custom_v3/resolve/main/model-resnet_custom_v3.pt\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/torch_deepdanbooru\")" ] }, { "cell_type": "markdown", "id": "f3ffda5a-55d2-42e7-bd47-ca69f55ae5c9", "metadata": {}, "source": [ "## 面部修复 预处理器下载" ] }, { "cell_type": "code", "execution_count": null, "id": "da223675-4c42-4808-8c42-14e141ec5297", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 面部修复 处理器下载 codeformer.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/YCL_MODEL/resolve/main/codeformer.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/Codeformer\")" ] }, { "cell_type": "code", "execution_count": null, "id": "a8c1b0e8-605e-45ee-b377-ed4151f787e4", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 面部修复 处理器下载 detection_Resnet50_Final.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/YCL_MODEL/resolve/main/detection_Resnet50_Final.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/repositories/CodeFormer/weights/facelib\")" ] }, { "cell_type": "code", "execution_count": null, "id": "042e15b8-0410-4fe7-85c3-de3258cf95a0", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 面部修复 处理器下载 parsing_parsenet.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/YCL_MODEL/resolve/main/parsing_parsenet.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/repositories/CodeFormer/weights/facelib\")" ] }, { "cell_type": "markdown", "id": "e1e5a90c-9aba-4af3-adc6-d6a6db22a6b2", "metadata": {}, "source": [ "## 高清修复 预处理器下载" ] }, { "cell_type": "markdown", "id": "d5ac67b4-02d1-40a5-88e4-a55632f3c6ff", "metadata": {}, "source": [ "## 1. ESRGAN 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "955b83f4-5029-43f8-8072-0eda82559fc1", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 BSRGAN.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/ESRGAN/BSRGAN.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/ESRGAN\")" ] }, { "cell_type": "code", "execution_count": null, "id": "b71e2a57-f4da-40b2-9f15-885cefe8a4c7", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 ESRGAN_4x.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/ESRGAN/ESRGAN_4x.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/ESRGAN\")" ] }, { "cell_type": "markdown", "id": "b91c4b41-d257-40d3-bfc6-9d76029ca086", "metadata": {}, "source": [ "## 2. GFPGAN 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "b2f708ab-7d24-432c-805c-2c022cd6b24a", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 detection_Resnet50_Final.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/GFPGAN/GFPGANv1.4.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/GFPGAN\")" ] }, { "cell_type": "code", "execution_count": null, "id": "14363eea-31cd-42e6-a3d1-5766bb004c8d", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 ESRGAN.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/GFPGAN/detection_Resnet50_Final.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/GFPGAN\")" ] }, { "cell_type": "code", "execution_count": null, "id": "07dcb915-c96e-464f-88a7-faabc093eb04", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 parsing_parsenet.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/GFPGAN/parsing_parsenet.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/GFPGAN\")" ] }, { "cell_type": "markdown", "id": "8ff644d1-e91d-4921-912a-ba76e2a49ac7", "metadata": {}, "source": [ "## 3. RealESRGAN 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "a2d51859-c420-424c-bbaf-623915268e94", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 RealESRGAN_x4plus.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/RealESRGAN/RealESRGAN_x4plus.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/RealESRGAN\")" ] }, { "cell_type": "code", "execution_count": null, "id": "e34a9f3b-c4ff-4351-abe7-0907b317f6d1", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 RealESRGAN_x4plus_anime_6B.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/RealESRGAN/RealESRGAN_x4plus_anime_6B.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/RealESRGAN\")" ] }, { "cell_type": "markdown", "id": "b789a9d0-fbd4-480e-bf7d-ae851987e5d0", "metadata": {}, "source": [ "## 4. ScuNET 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "fbe56093-6406-4e29-8e0b-62f46dab7a37", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 ScuNET.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/ScuNET/ScuNET.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/ScuNET\")" ] }, { "cell_type": "markdown", "id": "3489fe69-1575-4829-aa08-2da15c3445ba", "metadata": {}, "source": [ "## 5. SwinIR 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "1bd4d97a-c6e2-42ef-a932-28e799cf1fae", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 ESRGAN.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/YCL_MODEL/resolve/main/ESRGAN.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/SwinIR\")" ] }, { "cell_type": "markdown", "id": "b261a21d-a008-476d-b4e4-23946de36e25", "metadata": {}, "source": [ "## 6. torch_deepdanbooru 模型" ] }, { "cell_type": "code", "execution_count": null, "id": "b714bf2d-1252-41be-9b10-d39926e42a79", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 高清修复 处理器下载 ESRGAN.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/gaoqing_model/resolve/main/torch_deepdanbooru/model-resnet_custom_v3.pt\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/models/torch_deepdanbooru\")" ] }, { "cell_type": "markdown", "id": "c51506b2-c438-4c35-af25-350fdefa325b", "metadata": {}, "source": [ "## 安装 segment anything 插件模型" ] }, { "cell_type": "code", "execution_count": null, "id": "57afa4a3-4c48-4d6d-8741-61a341818dc9", "metadata": { "ExecutionIndicator": { "show": true }, "tags": [] }, "outputs": [], "source": [ "##安装 segment any thing sam_vit_h_4b8939.pth\n", "\n", "def aria2(url, filename, d):\n", " !aria2c --console-log-level=error -c -x 16 -s 16 {url} -o {filename} -d {d}\n", "\n", "model_url = \"https://huggingface.co/andzhang01/segment_anything/resolve/main/sam_vit_h_4b8939.pth\"\n", "aria2(model_url, model_url.split(\"/\")[-1], \"/mnt/workspace/stable-diffusion-webui/extensions/sd-webui-segment-anything/models/sam\")" ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.6" } }, "nbformat": 4, "nbformat_minor": 5 }