File size: 5,522 Bytes
c5f1aa3
02672f0
 
 
 
 
c5f1aa3
 
02672f0
0012bc9
02672f0
0012bc9
02672f0
c772ed6
02672f0
 
 
 
 
1ab9420
 
3496a13
 
34c6800
1ab9420
 
 
757a3e5
 
644764a
757a3e5
0397797
d858107
02672f0
 
9e47999
b7e7713
731bdfc
 
 
b7e7713
 
5672310
1ab9420
 
b7e7713
5672310
b7e7713
5672310
ade5686
 
 
 
5672310
 
1ab9420
 
fa7ddfe
5672310
7b81053
5672310
57bfde5
1ab9420
 
02672f0
 
274b466
13cf63d
02672f0
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
---
inference: false
tags:
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
license: creativeml-openrail-m
---

## Stable Diffusion TrinArt Characters model v1

trinart_characters_19.2m_stable_diffusion_v1 is a stable diffusion v1-based model trained by roughly 19.2M anime/manga style images (pre-rolled augmented images included) plus final finetuning by about 50,000 images. This model seeks for a sweet spot between artistic style versatility and anatomical quality within the given model spec of SDv1.

This is the same version 1 model that was released in AI Novelist/TrinArt service from early September through Oct 14. We are currently experimenting with the new Derrida model on TrinArt service for further improvement and anatomical stabilization. In the mean time, please enjoy this real-service-tested Characters v1!

#### Hardware

- 8xNVIDIA A100 40GB

#### Custom autoencoder

*Note: There was a wrong checkpoint uploaded before 5 Nov 2022. The file has been replaced with the latest checkpoint.*

We also provide a separate checkpoint for the custom KL autoencoder. As suggested by the Latent Diffusion paper, we found that training the autoencoder and the latent diffusion model separately improves the result. Since the official stable diffusion script does not support loading the other VAE, in order to run it in your script, you'll need to override state_dict for first_stage_model.

The popular WebUI has the script to load separate first_stage_model parameters.

#### Safety

The dataset is filtered to exclude NSFW or unsafe contents. After our extensive experimentation and testing with 10M+ user generated images, we decided that this model is safe enough and less likely to spit out questionable (nudity/overly sexual/realistic gore) content than the stock SD v1.4 model or other anime/manga models. However, if the user tortures this model enough until it talks, it may be still possible to force this model to generate obnoxious materials. We do not consider this model to be 100% risk-free.

*This statement does not necessarily restrict third-party from training a derivative of this model that includes NSFW.

#### Examples

Below images are directly generated by the native TrinArt service with its idiosyncratic upscaler, parser and processes. Your mileage may vary.

![examples](https://pbs.twimg.com/media/FeLNpeuVIAEUqKe?format=jpg&name=4096x4096)
(assorted random examples)

![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221005_c.webp)
![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221005_d.webp)
wide shot, high quality, htgngg animal arm rest brown hair merry chair cup dress flower from above jacket on shoulders long hair sitting solo sugar bowl fantasy adventurer's inn table teacup teapot landscape miniature (2022 Artstyle preset)
![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221016_a.webp)
highres wide shot bangs bare shoulders water bird cage terrarium detached sleeves frilled frilled legwear frills hair ornament hair ribbon hood long hair medium breasts ribbon thighhighs (2019 Artstyle preset)
![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221006_a.webp)
1girl standing holding sword hizzrd arm up bangs bare shoulders boots bow breasts bright pupils choker detached sleeves diamond (shape) floating floating hair footwear bow from side full body gloves leg up long hair looking at viewer open mouth outstretched arm solo streaked hair swept bangs two tone hair very long hair::4 angry::1 (2022 Artstyle preset)
![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221006_c.webp)
1boy male focus standing hizzrd holding sword arm up bow bright pupils cape coat diamond (shape) floating floating hair fold-over boots footwear bow from side full body gloves leg up long sleeves looking at viewer open mouth outstretched arm open coat open clothes solo swept two tone hair thigh boots::4 angry::1.25 (2022 Artstyle preset)

![examples](https://pbs.twimg.com/media/FeNv2QeUAAIvDO1?format=jpg&name=large)
cathedral 1girl schoolgirl momoko school uniform cats particles beautiful shooting stars detailed cathedral jacket open mouth glasses cats (2022 Artstyle preset)

![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221005_a.webp)
highres 2girls yuri wide shot bangs bare shoulders water bird cage terrarium detached sleeves frilled frilled legwear frills hair ornament hair ribbon hood long hair medium breasts ribbon thighhighs (More Details preset)
![examples](https://ai-novel.com/images/trinart_samples/trinart_sample_20221016_d.webp)
wide shot, best quality lapis erebcir highres 1boy bangs black gloves brown hair closed mouth gloves hair between eyes looking at viewer male focus flowers green eyes (More Details preset)

TrinArt 2022 Artstyle preset negative prompts: **retro style, 1980s, 1990s, 2000s, 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019**

TrinArt More Details preset negative prompts: **flat color, flat shading**

We recommend to add known sets of negative prompts in order to stabilize the anatomy such as: bad hands, fewer digits, etc.

#### Credits

- Sta, AI Novelist Dev (https://ai-novel.com/) @ Bit192, Inc. Twitter https://twitter.com/naclbbr (Japanese) https://twitter.com/naclbbre (English)

- Stable Diffusion - Rombach, Robin and Blattmann, Andreas and Lorenz, Dominik and Esser, Patrick and Ommer, Bjorn

#### License

CreativeML OpenRAIL-M