This Stable diffusion checkpoint allows you to generate pixel art sprite sheets from four different angles. These first images are my results after merging this model with another model trained on my wife. merging another model with this one is the easiest way to get a consistent character with each view. still requires a bit of playing around with settings in img2img to get them how you want. for left and right, I suggest picking your best result and mirroring. after you are satisfied take your photo into photoshop or Krita, remove the background, and scale to the desired size. after this you can scale back up to display your results; this also clears up some of the color murkiness in the initial outputs.
This model can be used just like any other Stable Diffusion model. For more information, please have a look at the Stable Diffusion.
#!pip install diffusers transformers scipy torch
from diffusers import StableDiffusionPipeline
model_id = "Onodofthenorth/SD_PixelArt_SpriteSheet_Generator"
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")
prompt = "PixelartLSS"
image = pipe(prompt).images
- Downloads last month