metadata
tags:
- stable-diffusion-xl
- stable-diffusion-xl-diffusers
- text-to-image
- diffusers
- lora
- template:sd-lora
widget:
- text: >-
A cloesup rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of back right side from back right
output:
url: image-0.png
- text: >-
A cloesup rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from bottom back
output:
url: image-1.png
- text: >-
A cloesup rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of front right side from front left
output:
url: image-2.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 334° degree
output:
url: image-3.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 72° degree
output:
url: image-4.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 84° degree
output:
url: image-5.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 96° degree
output:
url: image-6.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 108° degree
output:
url: image-7.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 120° degree
output:
url: image-8.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 132° degree
output:
url: image-9.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 144° degree
output:
url: image-10.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 166° degree
output:
url: image-11.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 178° degree
output:
url: image-12.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 170° degree
output:
url: image-13.png
- text: ' A rendering of <s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19> from 190° degree'
output:
url: image-14.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of top from top
output:
url: image-15.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 346° degree
output:
url: image-16.png
- text: ' A rendering of <s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19> from 202° degree'
output:
url: image-17.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 214° degree
output:
url: image-18.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 226° degree
output:
url: image-19.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 238° degree
output:
url: image-20.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 250° degree
output:
url: image-21.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 262° degree
output:
url: image-22.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 274° degree
output:
url: image-23.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 286° degree
output:
url: image-24.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 298° degree
output:
url: image-25.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 310° degree
output:
url: image-26.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 358° degree
output:
url: image-27.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 322° degree
output:
url: image-28.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 0° degree
output:
url: image-29.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 12° degree
output:
url: image-30.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 24° degree
output:
url: image-31.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 36° degree
output:
url: image-32.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 48° degree
output:
url: image-33.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 60° degree
output:
url: image-34.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of the left side from renderd from diagonal top
output:
url: image-35.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from bottom front right
output:
url: image-36.png
- text: >-
A cloeseup photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from front bottom left
output:
url: image-37.png
- text: >-
A cloeseup photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of the front from bottom right
output:
url: image-38.png
- text: >-
A cloeseup photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of the front from 0° front
output:
url: image-39.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from bottom left
output:
url: image-40.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from bottom left
output:
url: image-41.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from bottom right
output:
url: image-42.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of left side from diagonal top
output:
url: image-43.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
of right side straight from side
output:
url: image-44.png
- text: >-
A photo of front of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from top right
output:
url: image-45.png
- text: >-
A photo of front of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from top right
output:
url: image-46.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
climbing on a rock from right front
output:
url: image-47.png
- text: >-
A photo of left back of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
in a garden on a stonepath
output:
url: image-48.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
lifting his left front leg in the air
output:
url: image-49.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
standing on a podest from right bottom front
output:
url: image-50.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
puting up his right front leg on a wooden surface
output:
url: image-51.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
balancing on left legs on a wooden surface
output:
url: image-52.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
giving his front legs into human hands
output:
url: image-53.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
sitting in front of a man in a bedroom on a zebra carpet
output:
url: image-54.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
lying on floor from top right
output:
url: image-55.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
standing
output:
url: image-56.png
- text: >-
A rendering of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from 338° degree
output:
url: image-57.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
standing on a rock from right
output:
url: image-58.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
standing on on a plaza from front right
output:
url: image-59.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
going down stairs
output:
url: image-60.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
going up stairs
output:
url: image-61.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
going up stairs from back left
output:
url: image-62.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
going standing on a rock from bottom right
output:
url: image-63.png
- text: >-
A photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
lifting his front left and back right leg
output:
url: image-64.png
- text: >-
A wireframe of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
from front left
output:
url: image-65.png
base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: >-
A rendering or photo of
<s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
UnitreeGo2
license: openrail++
SDXL LoRA DreamBooth - nited/unitreego2
Model description
These are nited/unitreego2 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
Download model
Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
- LoRA: download
unitreego2.safetensors
here 💾.- Place it on your
models/Lora
folder. - On AUTOMATIC1111, load the LoRA by adding
<lora:unitreego2:1>
to your prompt. On ComfyUI just load it as a regular LoRA.
- Place it on your
- Embeddings: download
unitreego2_emb.safetensors
here 💾.- Place it on it on your
embeddings
folder - Use it by adding
unitreego2_emb
to your prompt. For example,A rendering or photo of unitreego2_emb UnitreeGo2
(you need both the LoRA and the embeddings as they were trained together for this LoRA)
- Place it on it on your
Use it with the 🧨 diffusers library
from diffusers import AutoPipelineForText2Image
import torch
from huggingface_hub import hf_hub_download
from safetensors.torch import load_file
pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('nited/unitreego2', weight_name='pytorch_lora_weights.safetensors')
embedding_path = hf_hub_download(repo_id='nited/unitreego2', filename='unitreego2_emb.safetensors' repo_type="model")
state_dict = load_file(embedding_path)
pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>", "<s2>", "<s3>", "<s4>", "<s5>", "<s6>", "<s7>", "<s8>", "<s9>", "<s10>", "<s11>", "<s12>", "<s13>", "<s14>", "<s15>", "<s16>", "<s17>", "<s18>", "<s19>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
pipeline.load_textual_inversion(state_dict["clip_g"], token=["<s0>", "<s1>", "<s2>", "<s3>", "<s4>", "<s5>", "<s6>", "<s7>", "<s8>", "<s9>", "<s10>", "<s11>", "<s12>", "<s13>", "<s14>", "<s15>", "<s16>", "<s17>", "<s18>", "<s19>"], text_encoder=pipeline.text_encoder_2, tokenizer=pipeline.tokenizer_2)
image = pipeline('A rendering or photo of <s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19> UnitreeGo2').images[0]
For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers
Trigger words
To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:
to trigger concept TOK
→ use <s0><s1><s2><s3><s4><s5><s6><s7><s8><s9><s10><s11><s12><s13><s14><s15><s16><s17><s18><s19>
in your prompt
Details
All Files & versions.
The weights were trained using 🧨 diffusers Advanced Dreambooth Training Script.
LoRA for the text encoder was enabled. False.
Pivotal tuning was enabled: True.
Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.