2d pixel art (beta) embedding for SD 2.0 768px
Hi - I am a big fan of retro/nostalgia things. This is the reason why I made this embedding. I have trained it on 70 images, the version I will be targeting in upcoming weeks will be based on 128 or 256 well-selected and filtered images, and processed through pixelate tool to keep the same pixel size on each of the input data. This should improve the embedding dramatically.
Images:
Installation:
Just drop the embedding files (.pt extension) to your SD embeddings folder (your-folder/embeddings).
Restart the app if running. Use the keyword as a filename ("pixelart" for example). You can rename them as you wish.
Before we start: cool tool to enhance your results even further: link
Version of Stable Diffusion: 2.0 - 768
Supported diffusers:
- Euler a (Preffered)
- DDIM
- other (partially)
Embeddings
pixelart: The most generic one. Usually gives decent pixels, reads quite well prompts, is not to "old-school". Used for "pixelating process" in img2img.
pixelart-soft: The softer version of an embedding. One of the most generic ones.Usually good for characters.
pixelart-hard: More pixelated version of embedding. Vintage/old-school. Depends on the topic - can be colorful or very vintage/dull.
pixelart-1 & pixelart-2: less generic ones. These sometimes give even better results than original (depends on topic, tags and diffuser)
pixelizer: Fun but chaotic one. Good for some experiments but usually gives colorful 8-bit like pixelated platformers/game screens stuff. I have left that one for experiments or as a factor for combination with other ones.
Usage
I highly recommend use these embeddings with Euler a diffuser. It will give usually best results. In some cases it would be
good to use negative prompts. Sometimes for testing if you caught good composition/colors - you might add or remove them
to impact the image.
negative prompt: Recommend this negative to test stuff when you get bad results: "3d, 3d render, disfigured, kitsch, ugly, oversaturated, grain, low-res, Deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, ugly, disgusting, poorly drawn, childish, mutilated, mangled, old, surreal"
If you have too much pixelated/chaotic output - add (all or some): "grid, Tetris, tetris blocks, mosaic, mosaic, pixelated, pixel art"
Img2img
The embeddings give you a great opportunity to change some of your works into pixel ones. The best way to do it is to follow this process:
First get your subject. If this is a simple image as:
Here it needed just one step!
What I did here was to use: Positive prompt: "game icon, raven, by pixelart, pixelated" (very important to add pixelated) Negative prompt: none (recommended, but you can of course experiment, especially if subject needs that) Sampler: Euler a (needed for any pixelation) steps: 20, CFG: 7, Denoising: 0.58. Resolution: 768x768.
The result:
Of course, the result can be better - you can re-roll to infinity or choose better settings or different embedding than recommended pixelart (in some cases you can try others)
Pixelating photos/more complex images: This is more tricky - but doable. As a baseline use the above settings, you can experiment with higher/lower CFG or denoising. To keep likeness I don't recommend you to go over 0.6 denoising. Replace the first part of the prompt with a simple description, at the end should be part: "by/in style pixelart, pixelated" Probably this will take up to 2-3 rounds. When I like the output - I set it as a base for next iteration. Then I reduce denoising by 0.4 each extra round. Of course this is rough process - might be different based on images.
Here are some examples:
Input:
Resuts:
I still investigating how to improve on the process.