alpha8 Robert Pattinson β€” SDXL LoRA

Character LoRA for Robert Pattinson trained on stabilityai/stable-diffusion-xl-base-1.0 (1024px, 1500 steps, network dim/alpha 8 or 16, lr 1e-4, batch 2, Adafactor, sdpa attention) on Kaggle GPU, fully offline and token-free.

Trigger

Use the trigger token alpha8 in your prompt:

alpha8 Robert Pattinson, portrait photo, studio lighting

Dataset

~100 curated images of Robert Pattinson, face-verified with OpenCV, captioned with a uniform stub (a photo of alpha8 person). The public training dataset is nekodeus/alpha8-robert-pattinson.

Training samples

Images from the actual training set are included in this repo under samples/:

sample 1 sample 2 sample 3 sample 4

Using the LoRA

diffusers

from diffusers import StableDiffusionXLPipeline

pipe = StableDiffusionXLPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0", torch_dtype=torch.float16
).to("cuda")
pipe.load_lora_weights("Nekodeus/neko-alpha8-sdxl-v1", weight_name="alpha8.safetensors")
image = pipe(f"alpha8 Robert Pattinson, portrait photo, studio lighting", width=1024, height=1024).images[0]

ComfyUI

Drop alpha8.safetensors into models/loras/, add a LoRA loader node and put alpha8 in the prompt.

Training details

setting value
base stabilityai/stable-diffusion-xl-base-1.0
resolution 1024
steps 1500
network dim / alpha 8 / 8 (some sets 16 / 16)
learning rate 1e-4
optimizer Adafactor, batch 2
hardware NVIDIA P100 (Kaggle)

Part of the Hollywood alpha series β€” see the full packs: Nekodeus/neko-hollywood-alpha-sd15-v1 (SD1.5) and Nekodeus/neko-hollywood-alpha-sdxl-v1 (SDXL).

Downloads last month
10
Inference Providers NEW

Model tree for Nekodeus/neko-alpha8-sdxl-v1

Adapter
(9,814)
this model