Text-to-image finetuning - michaelyli/sd-dsprites-star-toy

This pipeline was finetuned from runwayml/stable-diffusion-v1-5 on the michaelyli/dsprites-captions-simple dataset. Below are some example images generated with the finetuned pipeline using the following prompts: ['A medium-sized heart.', 'A large-sized square.', 'A small heart.']:

Pipeline usage

You can use the pipeline like so:

from diffusers import DiffusionPipeline
import torch

pipeline = DiffusionPipeline.from_pretrained("michaelyli/sd-dsprites-star-toy", torch_dtype=torch.float16)
prompt = "A medium-sized heart."
image = pipeline(prompt).images[0]
image.save("my_image.png")

Training info

These are the key hyperparameters used during training:

• Epochs: 7500
• Learning rate: 1e-05
• Batch size: 1000
• Gradient accumulation steps: 1
• Image resolution: 64
• Mixed-precision: fp16

More information on all the CLI arguments and the environment are available on your wandb run page.

Intended uses & limitations

How to use

# TODO: add an example code snippet for running this diffusion pipeline

Limitations and bias

[TODO: provide examples of latent issues and potential remediations]

Training details

[TODO: describe the data used to train the model]