metadata

license: openrail++

Texture Diffusion

This DreamBooth model is fine-tuned for diffuse textures. It produces flat textures with very little visible lighting/shadows.

Samples

Here are a few example images (generated with 50 steps).

pbr uneven stone wall	pbr dirt with weeds	pbr bright white marble

Usage

Use the token pbr in your prompts to invoke the style.

This model was made for use in Dream Textures, a Stable Diffusion add-on for Blender.

You can also use it with 🧨 diffusers:

from diffusers import StableDiffusionPipeline
import torch

model_id = "dream-textures/texture-diffusion"

pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

prompt = "pbr brick wall"
image = pipe(prompt).images[0]  
    
image.save("bricks.png")

Training Details

Base Model: stabilityai/stable-diffusion-2-base
Resolution: 512
Prior Loss Weight: 1.0
Class Prompt: texture
Batch Size: 1
Learning Rate: 1e-6
Precision: fp16
Steps: 4000
GPU: Tesla T4

Dataset

This model was trained on 278 CC0 textures from PolyHaven.