---
library_name: keras
license: apache-2.0
pipeline_tag: text-to-image
tags:
- keras-dreambooth
- scifi
---

## Model description

This model is a fine-tuned Stable Diffusion modeled, using the Dreambooth technique.
It was trained on 15 images of Marvin the Paranoid Android, scraped from the Internet, as instance images and 205 robot images generated 
by Stable Diffusion as class images. You can find the full set here: [Marvin the Paranoid Android](https://huggingface.co/datasets/keras-dreambooth/marvin_paranoid_android)

It was created by [johko](https://huggingface.co/johko) for the [keras-dreambooth](https://huggingface.co/keras-dreambooth) sprint.

## Training procedure

This model was trained using the keras implementation of dreambooth. 
You can find the notebook to train these models and how to attend this sprint [here](https://github.com/huggingface/community-events/tree/main/keras-dreambooth-sprint).


## Example Outputs

![Marvin as Anime character](marvin_anime.png) 
![Marvin as Lowpoly drawing](marvin_lowpoly.png) 
![Marvin as a pillow](marvin_pillow_hf.png) 

### Training hyperparameters

The following hyperparameters were used during training:

| Hyperparameters | Value |
| :-- | :-- |
| inner_optimizer.class_name | Custom>RMSprop |
| inner_optimizer.config.name | RMSprop |
| inner_optimizer.config.weight_decay | None |
| inner_optimizer.config.clipnorm | None |
| inner_optimizer.config.global_clipnorm | None |
| inner_optimizer.config.clipvalue | None |
| inner_optimizer.config.use_ema | False |
| inner_optimizer.config.ema_momentum | 0.99 |
| inner_optimizer.config.ema_overwrite_frequency | 100 |
| inner_optimizer.config.jit_compile | True |
| inner_optimizer.config.is_legacy_optimizer | False |
| inner_optimizer.config.learning_rate | 0.0010000000474974513 |
| inner_optimizer.config.rho | 0.9 |
| inner_optimizer.config.momentum | 0.0 |
| inner_optimizer.config.epsilon | 1e-07 |
| inner_optimizer.config.centered | False |
| dynamic | True |
| initial_scale | 32768.0 |
| dynamic_growth_steps | 2000 |
| training_precision | mixed_float16 |


 ## Model Plot

<details>
<summary>View Model Plot</summary>

![Model Image](./model.png)

</details>