|
--- |
|
license: mit |
|
datasets: |
|
- CyberHarem/charlotte_abelfreyja_drossel_violetevergarden |
|
- BangumiBase/violetevergarden |
|
pipeline_tag: text-to-image |
|
tags: |
|
- art |
|
- not-for-all-audiences |
|
--- |
|
|
|
# LoRA model of Charlotte Abelfreyja Drossel/γ·γ£γ«γγγγ»γ¨γΌγγ«γγ¬γ€γ€γ»γγγγ»γ« (Violet Evergarden) |
|
|
|
## What Is This? |
|
|
|
This is the LoRA model of waifu Charlotte Abelfreyja Drossel/γ·γ£γ«γγγγ»γ¨γΌγγ«γγ¬γ€γ€γ»γγγγ»γ« (Violet Evergarden). |
|
|
|
## How Is It Trained? |
|
|
|
* This model is trained with [kohya-ss/sd-scripts](https://github.com/kohya-ss/sd-scripts), and the test images are generated with [a1111's webui](AUTOMATIC1111/stable-diffusion-webui) and [API sdk](https://github.com/mix1009/sdwebuiapi). |
|
* The [auto-training framework](https://github.com/deepghs/cyberharem) is maintained by [DeepGHS Team](https://huggingface.co/deepghs). |
|
The architecture of base model is is `SD1.5`. |
|
* Dataset used for training is the `stage3-p480-1200` in [CyberHarem/charlotte_abelfreyja_drossel_violetevergarden](https://huggingface.co/datasets/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden), which contains 173 images. |
|
* The images in the dataset is auto-cropped from anime videos, more images for other waifus in the same anime can be found in [BangumiBase/violetevergarden](https://huggingface.co/datasets/BangumiBase/violetevergarden) |
|
* **Trigger word is `charlotte_abelfreyja_drossel_violetevergarden`.** |
|
* **Trigger word of anime style is is `anime_style`.** |
|
* Pruned core tags for this waifu are `brown hair, brown eyes, long hair, braid`. You can add them to the prompt when some features of waifu (e.g. hair color) are not stable. |
|
* For more details in training, you can take a look at [training configuration file](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/train.toml). |
|
* For more details in LoRA, you can download it, and read the metadata with a1111's webui. |
|
|
|
## How to Use It? |
|
|
|
After downloading the safetensors files for the specified step, you need to use them like common LoRA. |
|
|
|
* Recommended LoRA weight is 0.5-0.85. |
|
* Recommended trigger word weight is 0.7-1.1. |
|
|
|
For example, if you want to use the model from step 5832, you need to download [`5832/charlotte_abelfreyja_drossel_violetevergarden.safetensors`](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/5832/charlotte_abelfreyja_drossel_violetevergarden.safetensors) as LoRA. By using this model, you can generate images for the desired characters. |
|
|
|
## Which Step Should I Use? |
|
|
|
We selected 5 good steps for you to choose. The best one is step 5832. |
|
|
|
1600 images (1.75 GiB) were generated for auto-testing. |
|
|
|
![Metrics Plot](metrics_plot.png) |
|
|
|
Here are the preview of the recommended steps: |
|
|
|
| Step | Epoch | CCIP | AI Corrupt | Bikini Plus | Score | Download | pattern_0_0 | pattern_0_1 | pattern_1 | pattern_2_0 | pattern_2_1 | portrait_0 | portrait_1 | portrait_2 | full_body_0 | full_body_1 | profile_0 | profile_1 | free_0 | free_1 | shorts | maid_0 | maid_1 | miko | yukata | suit | china | bikini_0 | bikini_1 | bikini_2 | sit | squat | kneel | jump | crossed_arms | angry | smile | cry | grin | n_lie_0 | n_lie_1 | n_stand_0 | n_stand_1 | n_stand_2 | n_sex_0 | n_sex_1 | |
|
|-------:|--------:|:----------|:-------------|:--------------|:----------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------|:----------------------------------------------|:------------------------------------------|:----------------------------------------------|:----------------------------------------------|:--------------------------------------------|:--------------------------------------------|:--------------------------------------------|:----------------------------------------------|:----------------------------------------------|:------------------------------------------|:------------------------------------------|:------------------------------------|:------------------------------------|:------------------------------------|:------------------------------------|:------------------------------------|:--------------------------------|:------------------------------------|:--------------------------------|:----------------------------------|:----------------------------------------|:----------------------------------------|:----------------------------------------|:------------------------------|:----------------------------------|:----------------------------------|:--------------------------------|:------------------------------------------------|:----------------------------------|:----------------------------------|:------------------------------|:--------------------------------|:--------------------------------------|:--------------------------------------|:------------------------------------------|:------------------------------------------|:------------------------------------------|:--------------------------------------|:--------------------------------------| |
|
| 5832 | 108 | **0.862** | **0.993** | 0.830 | **0.820** | [Download](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/5832/charlotte_abelfreyja_drossel_violetevergarden.zip) | ![pattern_0_0](5832/previews/pattern_0_0.png) | ![pattern_0_1](5832/previews/pattern_0_1.png) | ![pattern_1](5832/previews/pattern_1.png) | ![pattern_2_0](5832/previews/pattern_2_0.png) | ![pattern_2_1](5832/previews/pattern_2_1.png) | ![portrait_0](5832/previews/portrait_0.png) | ![portrait_1](5832/previews/portrait_1.png) | ![portrait_2](5832/previews/portrait_2.png) | ![full_body_0](5832/previews/full_body_0.png) | ![full_body_1](5832/previews/full_body_1.png) | ![profile_0](5832/previews/profile_0.png) | ![profile_1](5832/previews/profile_1.png) | ![free_0](5832/previews/free_0.png) | ![free_1](5832/previews/free_1.png) | ![shorts](5832/previews/shorts.png) | ![maid_0](5832/previews/maid_0.png) | ![maid_1](5832/previews/maid_1.png) | ![miko](5832/previews/miko.png) | ![yukata](5832/previews/yukata.png) | ![suit](5832/previews/suit.png) | ![china](5832/previews/china.png) | ![bikini_0](5832/previews/bikini_0.png) | ![bikini_1](5832/previews/bikini_1.png) | ![bikini_2](5832/previews/bikini_2.png) | ![sit](5832/previews/sit.png) | ![squat](5832/previews/squat.png) | ![kneel](5832/previews/kneel.png) | ![jump](5832/previews/jump.png) | ![crossed_arms](5832/previews/crossed_arms.png) | ![angry](5832/previews/angry.png) | ![smile](5832/previews/smile.png) | ![cry](5832/previews/cry.png) | ![grin](5832/previews/grin.png) | ![n_lie_0](5832/previews/n_lie_0.png) | ![n_lie_1](5832/previews/n_lie_1.png) | ![n_stand_0](5832/previews/n_stand_0.png) | ![n_stand_1](5832/previews/n_stand_1.png) | ![n_stand_2](5832/previews/n_stand_2.png) | ![n_sex_0](5832/previews/n_sex_0.png) | ![n_sex_1](5832/previews/n_sex_1.png) | |
|
| 3726 | 69 | 0.752 | 0.990 | 0.842 | 0.743 | [Download](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/3726/charlotte_abelfreyja_drossel_violetevergarden.zip) | ![pattern_0_0](3726/previews/pattern_0_0.png) | ![pattern_0_1](3726/previews/pattern_0_1.png) | ![pattern_1](3726/previews/pattern_1.png) | ![pattern_2_0](3726/previews/pattern_2_0.png) | ![pattern_2_1](3726/previews/pattern_2_1.png) | ![portrait_0](3726/previews/portrait_0.png) | ![portrait_1](3726/previews/portrait_1.png) | ![portrait_2](3726/previews/portrait_2.png) | ![full_body_0](3726/previews/full_body_0.png) | ![full_body_1](3726/previews/full_body_1.png) | ![profile_0](3726/previews/profile_0.png) | ![profile_1](3726/previews/profile_1.png) | ![free_0](3726/previews/free_0.png) | ![free_1](3726/previews/free_1.png) | ![shorts](3726/previews/shorts.png) | ![maid_0](3726/previews/maid_0.png) | ![maid_1](3726/previews/maid_1.png) | ![miko](3726/previews/miko.png) | ![yukata](3726/previews/yukata.png) | ![suit](3726/previews/suit.png) | ![china](3726/previews/china.png) | ![bikini_0](3726/previews/bikini_0.png) | ![bikini_1](3726/previews/bikini_1.png) | ![bikini_2](3726/previews/bikini_2.png) | ![sit](3726/previews/sit.png) | ![squat](3726/previews/squat.png) | ![kneel](3726/previews/kneel.png) | ![jump](3726/previews/jump.png) | ![crossed_arms](3726/previews/crossed_arms.png) | ![angry](3726/previews/angry.png) | ![smile](3726/previews/smile.png) | ![cry](3726/previews/cry.png) | ![grin](3726/previews/grin.png) | ![n_lie_0](3726/previews/n_lie_0.png) | ![n_lie_1](3726/previews/n_lie_1.png) | ![n_stand_0](3726/previews/n_stand_0.png) | ![n_stand_1](3726/previews/n_stand_1.png) | ![n_stand_2](3726/previews/n_stand_2.png) | ![n_sex_0](3726/previews/n_sex_0.png) | ![n_sex_1](3726/previews/n_sex_1.png) | |
|
| 3402 | 63 | 0.736 | 0.988 | **0.843** | 0.728 | [Download](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/3402/charlotte_abelfreyja_drossel_violetevergarden.zip) | ![pattern_0_0](3402/previews/pattern_0_0.png) | ![pattern_0_1](3402/previews/pattern_0_1.png) | ![pattern_1](3402/previews/pattern_1.png) | ![pattern_2_0](3402/previews/pattern_2_0.png) | ![pattern_2_1](3402/previews/pattern_2_1.png) | ![portrait_0](3402/previews/portrait_0.png) | ![portrait_1](3402/previews/portrait_1.png) | ![portrait_2](3402/previews/portrait_2.png) | ![full_body_0](3402/previews/full_body_0.png) | ![full_body_1](3402/previews/full_body_1.png) | ![profile_0](3402/previews/profile_0.png) | ![profile_1](3402/previews/profile_1.png) | ![free_0](3402/previews/free_0.png) | ![free_1](3402/previews/free_1.png) | ![shorts](3402/previews/shorts.png) | ![maid_0](3402/previews/maid_0.png) | ![maid_1](3402/previews/maid_1.png) | ![miko](3402/previews/miko.png) | ![yukata](3402/previews/yukata.png) | ![suit](3402/previews/suit.png) | ![china](3402/previews/china.png) | ![bikini_0](3402/previews/bikini_0.png) | ![bikini_1](3402/previews/bikini_1.png) | ![bikini_2](3402/previews/bikini_2.png) | ![sit](3402/previews/sit.png) | ![squat](3402/previews/squat.png) | ![kneel](3402/previews/kneel.png) | ![jump](3402/previews/jump.png) | ![crossed_arms](3402/previews/crossed_arms.png) | ![angry](3402/previews/angry.png) | ![smile](3402/previews/smile.png) | ![cry](3402/previews/cry.png) | ![grin](3402/previews/grin.png) | ![n_lie_0](3402/previews/n_lie_0.png) | ![n_lie_1](3402/previews/n_lie_1.png) | ![n_stand_0](3402/previews/n_stand_0.png) | ![n_stand_1](3402/previews/n_stand_1.png) | ![n_stand_2](3402/previews/n_stand_2.png) | ![n_sex_0](3402/previews/n_sex_0.png) | ![n_sex_1](3402/previews/n_sex_1.png) | |
|
| 4050 | 75 | 0.731 | 0.991 | 0.843 | 0.721 | [Download](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/4050/charlotte_abelfreyja_drossel_violetevergarden.zip) | ![pattern_0_0](4050/previews/pattern_0_0.png) | ![pattern_0_1](4050/previews/pattern_0_1.png) | ![pattern_1](4050/previews/pattern_1.png) | ![pattern_2_0](4050/previews/pattern_2_0.png) | ![pattern_2_1](4050/previews/pattern_2_1.png) | ![portrait_0](4050/previews/portrait_0.png) | ![portrait_1](4050/previews/portrait_1.png) | ![portrait_2](4050/previews/portrait_2.png) | ![full_body_0](4050/previews/full_body_0.png) | ![full_body_1](4050/previews/full_body_1.png) | ![profile_0](4050/previews/profile_0.png) | ![profile_1](4050/previews/profile_1.png) | ![free_0](4050/previews/free_0.png) | ![free_1](4050/previews/free_1.png) | ![shorts](4050/previews/shorts.png) | ![maid_0](4050/previews/maid_0.png) | ![maid_1](4050/previews/maid_1.png) | ![miko](4050/previews/miko.png) | ![yukata](4050/previews/yukata.png) | ![suit](4050/previews/suit.png) | ![china](4050/previews/china.png) | ![bikini_0](4050/previews/bikini_0.png) | ![bikini_1](4050/previews/bikini_1.png) | ![bikini_2](4050/previews/bikini_2.png) | ![sit](4050/previews/sit.png) | ![squat](4050/previews/squat.png) | ![kneel](4050/previews/kneel.png) | ![jump](4050/previews/jump.png) | ![crossed_arms](4050/previews/crossed_arms.png) | ![angry](4050/previews/angry.png) | ![smile](4050/previews/smile.png) | ![cry](4050/previews/cry.png) | ![grin](4050/previews/grin.png) | ![n_lie_0](4050/previews/n_lie_0.png) | ![n_lie_1](4050/previews/n_lie_1.png) | ![n_stand_0](4050/previews/n_stand_0.png) | ![n_stand_1](4050/previews/n_stand_1.png) | ![n_stand_2](4050/previews/n_stand_2.png) | ![n_sex_0](4050/previews/n_sex_0.png) | ![n_sex_1](4050/previews/n_sex_1.png) | |
|
| 5670 | 105 | 0.749 | 0.992 | 0.829 | 0.704 | [Download](https://huggingface.co/CyberHarem/charlotte_abelfreyja_drossel_violetevergarden/resolve/main/5670/charlotte_abelfreyja_drossel_violetevergarden.zip) | ![pattern_0_0](5670/previews/pattern_0_0.png) | ![pattern_0_1](5670/previews/pattern_0_1.png) | ![pattern_1](5670/previews/pattern_1.png) | ![pattern_2_0](5670/previews/pattern_2_0.png) | ![pattern_2_1](5670/previews/pattern_2_1.png) | ![portrait_0](5670/previews/portrait_0.png) | ![portrait_1](5670/previews/portrait_1.png) | ![portrait_2](5670/previews/portrait_2.png) | ![full_body_0](5670/previews/full_body_0.png) | ![full_body_1](5670/previews/full_body_1.png) | ![profile_0](5670/previews/profile_0.png) | ![profile_1](5670/previews/profile_1.png) | ![free_0](5670/previews/free_0.png) | ![free_1](5670/previews/free_1.png) | ![shorts](5670/previews/shorts.png) | ![maid_0](5670/previews/maid_0.png) | ![maid_1](5670/previews/maid_1.png) | ![miko](5670/previews/miko.png) | ![yukata](5670/previews/yukata.png) | ![suit](5670/previews/suit.png) | ![china](5670/previews/china.png) | ![bikini_0](5670/previews/bikini_0.png) | ![bikini_1](5670/previews/bikini_1.png) | ![bikini_2](5670/previews/bikini_2.png) | ![sit](5670/previews/sit.png) | ![squat](5670/previews/squat.png) | ![kneel](5670/previews/kneel.png) | ![jump](5670/previews/jump.png) | ![crossed_arms](5670/previews/crossed_arms.png) | ![angry](5670/previews/angry.png) | ![smile](5670/previews/smile.png) | ![cry](5670/previews/cry.png) | ![grin](5670/previews/grin.png) | ![n_lie_0](5670/previews/n_lie_0.png) | ![n_lie_1](5670/previews/n_lie_1.png) | ![n_stand_0](5670/previews/n_stand_0.png) | ![n_stand_1](5670/previews/n_stand_1.png) | ![n_stand_2](5670/previews/n_stand_2.png) | ![n_sex_0](5670/previews/n_sex_0.png) | ![n_sex_1](5670/previews/n_sex_1.png) | |
|
|
|
## Anything Else? |
|
|
|
Because the automation of LoRA training always annoys some people. So for the following groups, it is not recommended to use this model and we express regret: |
|
1. Individuals who cannot tolerate any deviations from the original character design, even in the slightest detail. |
|
2. Individuals who are facing the application scenarios with high demands for accuracy in recreating character outfits. |
|
3. Individuals who cannot accept the potential randomness in AI-generated images based on the Stable Diffusion algorithm. |
|
4. Individuals who are not comfortable with the fully automated process of training character models using LoRA, or those who believe that training character models must be done purely through manual operations to avoid disrespecting the characters. |
|
5. Individuals who finds the generated image content offensive to their values. |
|
|
|
## All Steps |
|
|
|
We uploaded the files in all steps. you can check the images, metrics and download them in the following links: |
|
* [Steps From 5022 to 6480](all/0.md) |
|
* [Steps From 3402 to 4860](all/1.md) |
|
* [Steps From 1782 to 3240](all/2.md) |
|
* [Steps From 162 to 1620](all/3.md) |
|
|