File size: 2,496 Bytes
acc2b97 4e12e56 acc2b97 4e12e56 acc2b97 4e12e56 acc2b97 4e12e56 acc2b97 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
license: creativeml-openrail-m
language:
- en
thumbnail: "https://huggingface.co/Norod78/sd15-caricature-portraits-blip-captions/resolve/main/example/IMG_9234_cunet_anime_noise0.jpg"
tags:
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
datasets:
- Norod78/caricature-portraits-blip-captions-512
inference: true
---
# Caricature portraits diffusion model
Stable Diffusion v1.5 fine tuned on the 2D Caricature Dataset from [3D-CariGAN](https://github.com/qq775193759/3D-CariGAN) cropped to 512x512 and blip captioned
If you want more details on how to generate your own blip cpationed dataset see this [colab](https://colab.research.google.com/gist/Norod/ee6ee3c4bf11c2d2be531d728ec30824/buildimagedatasetwithblipcaptionsanduploadtohf.ipynb)
Training was done using this Hugging-Face's text to image training [script](https://github.com/huggingface/diffusers/blob/main/examples/text_to_image/train_text_to_image.py)
## About
Put in a text prompt and generate caricatures
## AUTOMATIC1111 webui checkpoint
The [main](https://huggingface.co/Norod78/sd15-caricature-portraits-blip-captions/tree/main) folder contains a .safetensors file to be put in [stable-diffusion-webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui) "stable-diffusion-webui/models/Stable-diffusion" folder and used to generate images
![Images generated by this model](https://huggingface.co/Norod78/sd15-caricature-portraits-blip-captions/resolve/main/example/2DF671DA-EF5A-401B-B7AB-45FCDBBB3676.jpg)
## Dataset and Training
Finetuned for 10,000 iterations upon [runwayml/stable-diffusion-v1-5](https://huggingface.co/runwayml/stable-diffusion-v1-5) on [BLIP captioned portraits portraits](https://huggingface.co/datasets/Norod78/caricature-portraits-blip-captions-512) using 1xA5000 GPU on my home desktop computer
Trained by [@Norod78](https://twitter.com/Norod78)
## The original Caricature dataset citation credits
```
@article{ye2021caricature,
author = {Ye, Zipeng and Xia, Mengfei and Sun, Yanan and Yi, Ran and Yu, Minjing and Zhang, Juyong and Lai, Yu-Kun and Liu, Yong-Jin},
title = {3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Normal Face Photos},
journal = {IEEE Transactions on Visualization and Computer Graphics},
year = {2021},
doi={10.1109/TVCG.2021.3126659},
}
```
![Images generated by this model](https://huggingface.co/Norod78/sd15-caricature-portraits-blip-captions/resolve/main/example/4A6C928A-5710-4124-8897-6740FCA23D86.jpg)
|