Jim carry

---
license: creativeml-openrail-m
---
### 💥🎨 The Simpsons dreambooth model.
This is a fine-tuned Stable Diffusion model based on The Simpsons.

Use **asim style** in your prompts.
The model has some trouble with double pupils and no pupils.
Using "cross-eyed" in the negative prompt appears to help?

### Sample images:
Samples are made with [dynamic prompts](https://github.com/adieyal/sd-dynamic-prompts), Euler 80 steps @ CFG 12. Negative prompts: watermark, text, signature, cross-eyed


![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_famous_people.png)
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_famous_people2.png)
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_characters.png)
For people / characters:
asim style. dramatic beautiful { headshot | portrait } of \_\_person\_\_ {outside { in a garden | in a desert | on a mountain top | at a roman ruin} {at sunrise | at sunset | on an overcast afternoon | in the rain | in the snow | at night} | inside {a fancy living room | on a movie set | a vast empty dark space  | a kaleidoscope | an ancient library}  with {spotlights | neon lights | soft mood lighting | firefly lights } }. detailed background.
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_animals.png)
For animals:
asim style. dramatic closeup national geographic image of a \_\_animal\_\_ in its natural habitat. at {sunrise|sunset|night}. detailed background.
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_buildings.png)
asim style. + random prompt from the internet of cool looking structures: steampunk library, tower of babel, tree house, haunted victorian.
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_landscapes.png)
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_famous_places.png)
biomes:
asim style. a beautiful {summer | autumn | winter | spring } landscape panorama painting of \_\_biome\_\_ {at sunrise | at sunset | on an overcast afternoon | in the rain | in the snow | at night}

famous places: 
asim style. a beautiful panorama view of \_\_places\_\_ {at sunrise | at sunset | on a cloudy afternoon | in the rain | covered in snow}.
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_flowers.png)
flowers: 
asim style. a beautiful vase of \_\_flower\_\_ flowers. on a balcony table at { sunrise | sunset | night} . nearby a {bottle of {beer | wine}  and a half-empty glass | bowl of fruit}.
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_internet_examples.png)
![asim.jpg](https://huggingface.co/PiyarSquare/sd_asim_simpsons/resolve/main/grid_internet_examples2.png)
asim style. + random prompt from the internet. The model mixes well with existing prompts with artists and styles, though not so well with keywords like "photo-realistic."

Based on StableDiffusion 1.5 model (full weights).

### Training
Made with [automatic1111 webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui) + [d8ahazard dreambooth extension](https://github.com/d8ahazard/sd_dreambooth_extension) + [nitrosocke guide](https://github.com/nitrosocke/dreambooth-training-guide).

100 hand-cut training images.
About 70% people, 20% landscapes and 10% animals and objects.
Maybe one too many Cletus.
Detailed captions were written for each image such as: "A wide shot of a 40-year-old Caucasian man with glasses and a mustache. Dressed in a fishing hat, pink shirt, an olive fishing vest with pockets and brown trousers, sitting in a canoe on a lake. The man is fishing with a red fishing rod. There are trees and mountains in the background at sunset with a few clouds in the sky."

Learning rate was 1.72e-6 for 10,000 steps without prior preservation.
Useful tips from the reddit stablediffusion and the discussions on d8ahazard's extension.
Notes on training on [d8ahazard dreambooth extension discussion](https://github.com/d8ahazard/sd_dreambooth_extension/discussions/443).

I am excited to see what people do with this and I would like to improve the eyes, if anyone has suggestions.