mio commited on
Commit
9aa6d23
1 Parent(s): 5a7c91c

model card

Browse files
README.md CHANGED
@@ -1,3 +1,71 @@
1
  ---
2
  license: creativeml-openrail-m
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: creativeml-openrail-m
3
+ thumbnail: "https://huggingface.co/mio/hiten/resolve/main/example_images/1.jpeg"
4
+ tags:
5
+ - stable-diffusion
6
+ - stable-diffusion-diffusers
7
+ - text-to-image
8
+ - diffusers
9
+ inference: true
10
  ---
11
+
12
+ # Hiten Diffusion
13
+
14
+ **Welcome to Hiten Diffusion** - a latent diffusion model that has been trained on Chinese TaiWan Artist artwork, [hiten](https://www.pixiv.net/users/490219). The current model has been fine-tuned with a learning rate of `2.0e-6` for `10 Epochs` on `467 images` collected from Danbooru. The model is trained using [NovelAI Aspect Ratio Bucketing Tool](https://github.com/NovelAI/novelai-aspect-ratio-bucketing) so that it can be trained at non-square resolutions. Like other anime-style Stable Diffusion models, it also supports Danbooru tags to generate images.
15
+
16
+ e.g. **_1girl, white hair, golden eyes, beautiful eyes, detail, flower meadow, cumulonimbus clouds, lighting, detailed sky, garden_**
17
+
18
+ ## 🧨 Diffusers
19
+
20
+ This model can be used just like any other Stable Diffusion model. For more information,
21
+ please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
22
+
23
+ You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX]().
24
+
25
+ ```python
26
+ from diffusers import StableDiffusionPipeline
27
+ import torch
28
+
29
+ model_id = "mio/hiten"
30
+ pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
31
+ pipe = pipe.to("cuda")
32
+
33
+ prompt = "1girl,solo,miku"
34
+ image = pipe(prompt).images[0]
35
+
36
+ image.save("./miku.png")
37
+ ```
38
+
39
+ ## Examples
40
+
41
+ Below are some examples of images generated using this model:
42
+
43
+ ![AnimeGirl](https://huggingface.co/mio/hiten/resolve/main/example_images/1.jpeg)
44
+ ![AnimeGirl](https://huggingface.co/mio/hiten/resolve/main/example_images/2.jpeg)
45
+ ![AnimeGirl](https://huggingface.co/mio/hiten/resolve/main/example_images/3.jpeg)
46
+ ![AnimeGirl](https://huggingface.co/mio/hiten/resolve/main/example_images/4.jpeg)
47
+
48
+ ### Prompt and settings for Example Images
49
+
50
+ **Anime Girl:**
51
+ ```
52
+ (((masterpiece))),(((best quality))),((ultra-detailed)), ((illustration)),floating, ((an extremely delicate and beautiful)),(beautiful detailed eyes),((disheveled hair)),1girl, bangs, black_hair, blue_sailor_collar, blurry, blurry_background, depth_of_field, eyebrows_visible_through_hair, long_hair, looking_at_viewer, parted_lips, sailor_collar, school_uniform, serafuku, shirt, solo, yoroizuka_mizore,medium_chest,colourful_stages,crown,masterpiece,full_body,white_thighhighs,extremely_detailed_CG_unity_8k_wallpaper,solo,1girl,lights
53
+
54
+ Negative prompt: nsfw,nipples,lowres,bad anatomy,bad hands, text, error, missing fingers,extra digit, fewer digits, cropped, worstquality, low quality, normal quality,jpegartifacts,signature, watermark, username,blurry,bad feet, (((mutilated))),(((((too many fingers))))),((((fused fingers)))),(((extra fingers))),(((mutated hands))),extra limbs,(bad_prompt), (((mutilated))),(((((too many fingers))))),((((fused fingers)))),(((extra fingers)))
55
+
56
+ Steps: 24, Sampler: DPM2 a Karras, CFG scale: 7, Seed: 3722281017, Size: 512x768, Model hash: 53a39f6a, Model: hiten_epoch10, Batch size: 4, Batch pos: 3, Clip skip: 2, ENSD: 31337
57
+ ```
58
+
59
+ ## License
60
+
61
+ This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage.
62
+ The CreativeML OpenRAIL License specifies:
63
+
64
+ 1. You can't use the model to deliberately produce nor share illegal or harmful outputs or content
65
+ 2. The authors claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
66
+ 3. You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully)
67
+ [Please read the full license here](https://huggingface.co/spaces/CompVis/stable-diffusion-license)
68
+
69
+ ## Big Thanks to
70
+ - [Linaqruf](https://huggingface.co/Linaqruf) for his first step.
71
+ - [Kohya](https://twitter.com/kohya_ss) with their [Kohya Trainer](https://note.com/kohya_ss/n/ne17e34dd51bf)
example_images/1.jpeg ADDED
example_images/2.jpeg ADDED
example_images/3.jpeg ADDED
example_images/4.jpeg ADDED