license: creativeml-openrail-m
Mo Di Diffusion
This is the fine-tuned Stable Diffusion model trained on screenshots from the modern age Disney movies. Use the tokens modern disney style in your prompts for the effect.
If you enjoy this model, please check out my other models on Huggingface
Videogame Characters rendered with the model:
Animal Characters rendered with the model:
Cars and Landscapes rendered with the model:
🧨 Diffusers
This model can be used just like any other Stable Diffusion model. For more information, please have a look at the Stable Diffusion.
You can also export the model to ONNX, MPS and/or FLAX/JAX.
from diffusers import StableDiffusionPipeline
import torch
model_id = "nitrosocke/mo-di-diffusion"
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")
prompt = "a magical princess with golden hair, modern disney style"
image = pipe(prompt).images[0]
image.save("./magical_princess.png")
Gradio & Colab
We also support a Gradio Web UI and Colab with Diffusers to run fine-tuned Stable Diffusion models:
Prompt and settings for Lara Croft:
modern disney lara croft Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 3940025417, Size: 512x768
Prompt and settings for Simba:
modern disney (baby simba) Negative prompt: person human Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 1355059992, Size: 512x512
This model was trained using the diffusers based dreambooth training and prior-preservation loss in 9.000 steps and using the train-text-encoder feature.