File size: 4,579 Bytes
80f03ba
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bc25d31
80f03ba
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bc25d31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
---
license: mit
---

<h1 style="font-size: 2em; text-align: center; font-weight: bold; color: #FF69B4; text-shadow: 1px 1px 2px rgba(0, 0, 0, 0.2); font-family: 'Arial', sans-serif;">
  Momo XL - Anime-Style SDXL Base Model
</h1>




<style>
.gallery {
  display: flex;
  flex-wrap: wrap;
  justify-content: center;
}

.gallery img {
  width: 30%;
  margin: 1%;
}

.gallery img.wide {
  width: 45%;
}

</style>

<div class="gallery">
  <img src="./card_images/01.png" alt="Sample Image 1">
  <img src="./card_images/02.png" alt="Sample Image 2">
  <img src="./card_images/03.png" alt="Sample Image 3">
  <img src="./card_images/04.png" alt="Sample Image 4">
  <img src="./card_images/05.png" alt="Sample Image 5">
  <img src="./card_images/06.png" alt="Sample Image 6">
  <img src="./card_images/07.png" alt="Sample Image 7">
  <img src="./card_images/08.png" alt="Sample Image 8">
  <img src="./card_images/09.png" alt="Sample Image 9">
  <img src="./card_images/10.png" class="wide" alt="Sample Image 10">
  <img src="./card_images/11.png" class="wide" alt="Sample Image 11">
</div>

**Momo XL** is an anime-style model based on SDXL, fine-tuned to produce high-quality anime-style images with detailed and vibrant aesthetics. (Oct 6, 2024)

## Key Features:

- **Anime-Focused SDXL**: Tailored for generating high-quality anime-style images, making it ideal for artists and enthusiasts.
- **Optimized for Tag-Based Prompting**: Works best when prompted with descriptive tags, ensuring accurate and relevant outputs.
- **LoRA Compatible**: Compatible with most LoRA models available on the hub, allowing for versatile customization and style transfer.

## Usage Instructions:

- **Tagging**: Use descriptive tags separated by commas to guide the image generation. Tags can be arranged in any order to suit your creative needs.
- **Year-Specific Styles**: To emulate art styles from a specific year, use the tag format "**`year 20XX`**" (e.g., "**`year 2023`**").
- **LoRA Models**: Momo XL supports most LoRA models, enabling enhanced and tailored outputs for your projects.

## Disclaimer:

This model may produce unexpected or unintended results. **Use with caution and at your own risk.**

**Important Notice:**

- **Ethical Use**: Please ensure that your use of this model is ethical and complies with all applicable laws and regulations.
- **Content Responsibility**: Users are responsible for the content they generate. Do not use the model to create or disseminate illegal, harmful, or offensive material.
- **Data Sources**: The model was trained on publicly available datasets. While efforts have been made to filter and curate the training data, some undesirable content may remain.

Thank you! 😊


------------------------------------------------------
## Momo XL - Training Details (Oct 15, 2024)

### Dataset
Momo XL was trained using a dataset of over **400,000+ images** sourced from Danbooru.

### Base Model
Momo XL was built on top of SDXL, incorporating knowledge from two finetuned models:
- Formula:  
  `SDXL_base + (Animagine 3.0 base - SDXL_base) * 1.0 + (Pony V6 - SDXL_base) * 0.5`

For more details:
- [Animagine 3.0 base](https://huggingface.co/Linaqruf/animagine-xl-3.0)
- [Pony V6](https://huggingface.co/LyliaEngine/Pony_Diffusion_V6_XL)

### Training Process
Training was conducted on **A100 80GB GPUs**, totaling over **2000+ GPU hours**. The training was divided into three stages:
- **Finetuning - First Stage**: Trained on the entire dataset with a defined set of training configurations.
- **Finetuning - Second Stage**: Also trained on the entire dataset with some variations in settings.
- **Adjustment Stage**: Focused on aesthetic adjustments to improve the overall visual quality.

The final model, **Momo XL**, was released by merging the Text Encoder from the Finetuning Second Stage with the UNet from the Adjustment Stage. 

### Hyperparameters

| Stage                    | Epochs | UNet lr | Text Encoder lr | Batch Size | Resolution | Noise Offset | Optimizer  | LR Scheduler |
|--------------------------|--------|---------|-----------------|------------|------------|--------------|------------|--------------|
| **Finetuning 1st Stage**  | 10     | 2e-5    | 1e-5            | 256        | 1024²      | N/A          | AdamW8bit  | Constant     |
| **Finetuning 2nd Stage**  | 10     | 2e-5    | 1e-5            | 256        | Max. 1280² | N/A          | AdamW      | Constant     |
| **Adjustment Stage**      | 0.25   | 8e-5    | 4e-5            | 1024       | Max. 1280² | 0.05         | AdamW      | Constant     |