| # v2.1 & v2.0 | |
| [Other versions](https://huggingface.co/gustproof/sd-models/tree/main/mirishita) | |
| A LoRA based on 3636 Theater Days cards, recognizing 50+ characters to varying degrees. | |
| Resumed from [deresute-v1.2](https://huggingface.co/gustproof/sd-models/blob/main/deresute/checkpoints/deresute-v1.2.safetensors). Unlike [shinymas-v2.1](https://civitai.com/models/17978?modelVersionId=44963), this time a signifcant portion of prior knowledge is lost, possibly due to namespace clash or model capacity. | |
| Twintails are hard. | |
| ## Usage | |
| The style itself doesn't have a trigger word. For the characters, below are the character tags and respective top 20 related tags. | |
| ``` | |
| YURIKO NANAO, | |
| yellow eyes, blue hair, smile, short hair, 1girl, blush, solo, looking at viewer, open mouth, braid, dress, bow, :d, skirt, bangs, hair ornament, book, frills, ribbon, jewelry | |
| MATSURI TOKUGAWA, | |
| brown eyes, green hair, open mouth, looking at viewer, smile, 1girl, solo, blush, ribbon, bangs, hairband, dress, curly hair, :d, frills, parted bangs, jewelry, medium hair, hair ribbon, multiple girls | |
| ARISA MATSUDA, | |
| brown hair, twintails, brown eyes, smile, 1girl, open mouth, long hair, solo, looking at viewer, blush, :d, skirt, bangs, one eye closed, multiple girls, dress, bow, v, hair bow, hair ornament | |
| MIRAI KASUGA, | |
| brown hair, smile, open mouth, hair ornament, one side up, brown eyes, 1girl, short hair, hairclip, solo, looking at viewer, :d, blush, skirt, ribbon, closed eyes, multiple girls, jewelry, dress, hair ribbon | |
| KANA YABUKI, | |
| short hair, ahoge, open mouth, smile, brown hair, blush, 1girl, solo, brown eyes, looking at viewer, orange hair, yellow eyes, skirt, bow, :d, hair ornament, multiple girls, bangs, dress, closed eyes | |
| EMILY STEWART, | |
| blonde hair, long hair, twintails, purple eyes, 1girl, smile, solo, blush, open mouth, looking at viewer, dress, hairband, :d, bow, jewelry, multiple girls, gloves, hair ornament, flower, frills | |
| SHIHO KITAZAWA, | |
| brown hair, long hair, brown eyes, 1girl, smile, looking at viewer, solo, blush, open mouth, dress, jewelry, multiple girls, skirt, hair ornament, gloves, choker, necklace, star, lens flare, hat | |
| UMI KOUSAKA, | |
| long hair, brown hair, braid, smile, open mouth, looking at viewer, aqua eyes, 1girl, twin braids, blue eyes, solo, :d, blush, multiple girls, jewelry, skirt, dress, gloves, bangs, one eye closed | |
| SERIKA HAKOZAKI, | |
| twintails, brown hair, brown eyes, ahoge, long hair, open mouth, 1girl, smile, solo, looking at viewer, dress, blush, :d, ribbon, hair ornament, skirt, multiple girls, bow, hair ribbon, jewelry | |
| TSUBASA IBUKI, | |
| short hair, ahoge, pink eyes, 1girl, brown hair, smile, looking at viewer, open mouth, solo, blush, blonde hair, skirt, jewelry, bangs, dress, hair ornament, messy hair, hair between eyes, one eye closed, :d | |
| JULIA, | |
| short hair, blue eyes, red hair, 1girl, looking at viewer, smile, solo, open mouth, star, brown hair, dress, blush, jewelry, hair ornament, instrument, guitar, :d, skirt, multiple girls, necklace | |
| REIKA KITAKAMI, | |
| long hair, blue hair, twintails, smile, brown eyes, open mouth, 1girl, looking at viewer, solo, blush, :d, bangs, low twintails, jewelry, skirt, breasts, multiple girls, dress, gloves, hair ornament | |
| TOMOKA TENKUBASHI, | |
| brown hair, brown eyes, smile, 1girl, looking at viewer, hair bun, long hair, single hair bun, open mouth, solo, dress, blush, jewelry, hair ornament, skirt, :d, flower, frills, multiple girls, sidelocks | |
| SHIZUKA MOGAMI, | |
| long hair, black hair, blue eyes, 1girl, solo, smile, open mouth, looking at viewer, dress, blush, half updo, multiple girls, bow, jewelry, skirt, :d, blue hair, gloves, hair ornament, bangs | |
| ANNA MOCHIZUKI, | |
| long hair, ahoge, purple hair, aqua eyes, looking at viewer, 1girl, smile, open mouth, solo, blush, :d, hair between eyes, dress, skirt, blue hair, hair ornament, multiple girls, bangs, long sleeves, jewelry | |
| KOTOHA TANAKA, | |
| brown hair, long hair, brown eyes, open mouth, smile, 1girl, hairband, solo, looking at viewer, blush, dress, bangs, :d, jewelry, multiple girls, skirt, hair ornament, gloves, shirt, flower | |
| MOMOKO SUOU, | |
| brown hair, blue eyes, short hair, smile, open mouth, 1girl, hair ornament, looking at viewer, solo, ahoge, dress, blush, flower, multiple girls, hair flower, :d, bangs, skirt, frills, short sleeves | |
| MIZUKI MAKABE, | |
| short hair, yellow eyes, purple hair, 1girl, looking at viewer, solo, open mouth, blush, smile, grey hair, dress, multiple girls, skirt, jewelry, hair ornament, bow, sidelocks, 2girls, long sleeves, bracelet | |
| KONOMI BABA, | |
| brown hair, braid, aqua eyes, smile, single braid, long hair, 1girl, looking at viewer, open mouth, hair over shoulder, blush, solo, dress, jewelry, hair ornament, multiple girls, skirt, blue eyes, bangs, one eye closed | |
| HINATA KINOSHITA, | |
| brown hair, short hair, smile, ahoge, green eyes, open mouth, 1girl, blush, solo, looking at viewer, dress, :d, hair ornament, skirt, multiple girls, food, 2girls, hat, frills, bow | |
| AYUMU MAIHAMA, | |
| pink hair, pink eyes, multicolored hair, smile, 1girl, open mouth, looking at viewer, ponytail, long hair, solo, streaked hair, blonde hair, jewelry, blush, :d, multiple girls, jacket, bangs, necklace, hair ornament | |
| SAYOKO TAKAYAMA, | |
| long hair, black hair, 1girl, open mouth, brown eyes, solo, smile, looking at viewer, blush, red eyes, dress, :d, glasses, skirt, jewelry, bangs, hair ornament, multiple girls, gloves, twintails | |
| ROCO HANDA, | |
| long hair, grey hair, 1girl, solo, smile, green eyes, blush, bow, looking at viewer, open mouth, yellow eyes, hair bow, twintails, :d, hair ornament, jewelry, dress, brown hair, multiple girls, v-shaped eyebrows | |
| MEGUMI TOKORO, | |
| long hair, brown hair, blue eyes, ahoge, 1girl, smile, looking at viewer, open mouth, solo, jewelry, blush, bangs, breasts, dress, necklace, earrings, multiple girls, hair ornament, medium breasts, skirt | |
| ELENA SHIMABARA, | |
| green hair, long hair, ahoge, smile, open mouth, 1girl, hairband, blush, solo, looking at viewer, blue eyes, jewelry, aqua eyes, :d, bangs, dress, multiple girls, closed eyes, hair ornament, skirt | |
| SUBARU NAGAYOSHI, | |
| short hair, brown hair, smile, open mouth, 1girl, purple eyes, solo, green hair, looking at viewer, blush, :d, dress, multiple girls, jewelry, skirt, bangs, hair ornament, bow, jacket, gloves | |
| MIYA MIYAO, | |
| brown hair, long hair, smile, brown eyes, open mouth, 1girl, solo, looking at viewer, blush, dress, :d, bangs, thick eyebrows, hair ornament, jewelry, multiple girls, gloves, flower, skirt, long sleeves | |
| IKU NAKATANI, | |
| black hair, short hair, brown eyes, open mouth, smile, 1girl, solo, looking at viewer, hair ornament, blush, one side up, dress, bow, :d, bangs, multiple girls, brown hair, long sleeves, 2girls, closed eyes | |
| AKANE NONOHARA, | |
| short hair, smile, brown hair, brown eyes, 1girl, looking at viewer, open mouth, solo, jewelry, blush, red hair, one eye closed, dress, earrings, :d, hair ornament, gloves, multiple girls, closed eyes, bow | |
| RIO MOMOSE, | |
| long hair, brown hair, 1girl, looking at viewer, smile, solo, jewelry, breasts, blush, purple eyes, open mouth, cleavage, medium breasts, brown eyes, blonde hair, necklace, dress, earrings, one eye closed, bracelet | |
| KAREN SHINOMIYA, | |
| long hair, blue eyes, brown hair, 1girl, smile, looking at viewer, solo, blush, blonde hair, open mouth, jewelry, dress, aqua eyes, multiple girls, :d, hair ornament, skirt, gloves, bracelet, closed eyes | |
| FUKA TOYOKAWA, | |
| short hair, blue hair, smile, brown eyes, 1girl, open mouth, solo, breasts, antenna hair, looking at viewer, blush, jewelry, :d, dress, hair ornament, multiple girls, skirt, necklace, large breasts, bracelet | |
| TAMAKI OGAMI, | |
| long hair, smile, 1girl, one side up, open mouth, brown hair, solo, looking at viewer, brown eyes, :d, blush, orange hair, hair ornament, orange eyes, dress, shorts, jacket, v-shaped eyebrows, multiple girls, hat | |
| MINAKO SATAKE, | |
| brown hair, ponytail, blue eyes, open mouth, smile, looking at viewer, 1girl, long hair, solo, ribbon, :d, blush, hair ribbon, dress, multiple girls, jewelry, skirt, hair ornament, bow, food | |
| CHIHAYA KISARAGI, | |
| blue hair, long hair, brown eyes, 1girl, solo, smile, open mouth, looking at viewer, blush, :d, dress, skirt, bangs, hair ornament, jewelry, gloves, cowboy shot, short sleeves, jacket, long sleeves | |
| CHIZURU NIKAIDO, | |
| long hair, green eyes, brown hair, smile, 1girl, ponytail, open mouth, solo, looking at viewer, jewelry, blush, dress, :d, very long hair, hairband, earrings, hair ornament, necklace, bracelet, v-shaped eyebrows | |
| NAO YOKOYAMA, | |
| brown hair, ahoge, side ponytail, purple eyes, 1girl, smile, solo, looking at viewer, open mouth, drill hair, hair ornament, long hair, jewelry, blush, dress, bangs, one eye closed, skirt, standing, cowboy shot | |
| RITSUKO AKIZUKI, | |
| brown hair, glasses, brown eyes, antenna hair, 1girl, smile, braid, twin braids, open mouth, solo, looking at viewer, jewelry, long hair, dress, skirt, gloves, :d, multiple girls, blush, necklace | |
| MIKI HOSHII, | |
| long hair, blonde hair, ahoge, green eyes, 1girl, solo, smile, looking at viewer, open mouth, blush, jewelry, dress, skirt, gloves, hair between eyes, hair ornament, bangs, one eye closed, shirt, breasts | |
| HARUKA AMAMI, | |
| short hair, brown hair, smile, green eyes, 1girl, open mouth, ribbon, solo, looking at viewer, hair ribbon, blush, :d, skirt, hair ornament, bow, bangs, dress, hair bow, multiple girls, short sleeves | |
| NORIKO FUKUDA, | |
| short hair, brown eyes, blonde hair, smile, 1girl, looking at viewer, open mouth, solo, jewelry, blush, brown hair, earrings, :d, dress, hair ornament, skirt, jacket, multiple girls, bracelet, necklace | |
| AZUSA MIURA, | |
| blue hair, ahoge, short hair, smile, 1girl, red eyes, open mouth, solo, looking at viewer, jewelry, breasts, blush, necklace, :d, dress, skirt, multiple girls, bracelet, cleavage, earrings | |
| MAMI FUTAMI, | |
| brown hair, side ponytail, brown eyes, smile, 1girl, looking at viewer, solo, open mouth, long hair, hair ornament, star, :d, shiny, shiny hair, multiple girls, standing, shorts, skirt, cowboy shot, ribbon | |
| TAKANE SHIJOU, | |
| long hair, grey hair, 1girl, smile, solo, looking at viewer, pink eyes, purple eyes, hairband, open mouth, bangs, blush, hair ornament, dress, skirt, wavy hair, gloves, jewelry, long sleeves, :d | |
| IORI MINASE, | |
| brown hair, long hair, 1girl, solo, smile, looking at viewer, brown eyes, red eyes, blush, open mouth, hairband, dress, bow, standing, cowboy shot, skirt, jewelry, very long hair, one eye closed, hair bow | |
| MAKOTO KIKUCHI, | |
| short hair, black hair, antenna hair, smile, 1girl, solo, black eyes, looking at viewer, open mouth, dress, blush, gloves, jewelry, :d, hair ornament, short sleeves, one eye closed, frills, hair between eyes, multiple girls | |
| YAYOI TAKATSUKI, | |
| twintails, smile, open mouth, brown hair, 1girl, orange hair, solo, hair ornament, :d, blush, looking at viewer, blue eyes, dress, green eyes, skirt, long hair, bangs, jewelry, star, closed eyes | |
| KAORI SAKURAMORI, | |
| ahoge, braid, brown hair, short hair, green eyes, smile, light brown hair, open mouth, blush, 1girl, solo, looking at viewer, bangs, skirt, jewelry, dress, breasts, medium breasts, multiple girls, necklace | |
| HIBIKI GANAHA, | |
| long hair, black hair, ponytail, blue eyes, open mouth, smile, 1girl, antenna hair, fang, solo, looking at viewer, :d, bangs, blush, ribbon, jewelry, high ponytail, very long hair, skirt, short sleeves | |
| YUKIHO HAGIWARA, | |
| short hair, brown hair, brown eyes, open mouth, 1girl, smile, bob cut, solo, blush, looking at viewer, dress, skirt, :d, hair ornament, jewelry, multiple girls, frills, bangs, closed eyes, bow | |
| TSUMUGI SHIRAISHI, | |
| long hair, blue eyes, grey hair, 1girl, hair ornament, solo, bangs, looking at viewer, blush, smile, open mouth, blue hair, dress, hairclip, short sleeves, very long hair, closed mouth, standing, jewelry, skirt | |
| AMI FUTAMI, | |
| brown hair, brown eyes, short hair, smile, 1girl, solo, side ponytail, looking at viewer, open mouth, hair ornament, one side up, ribbon, skirt, jewelry, star, blush, :d, multiple girls, hair ribbon, dress | |
| SHIKA, | |
| smile, open mouth, 1girl, green hair, bow, blush, solo, shirt, bangs, looking at viewer, grey eyes, skirt, hair bow, short sleeves, white shirt, medium hair, :d, short hair, bowtie, breasts | |
| LEON, | |
| long hair, smile, brown hair, 1girl, heterochromia, blue eyes, solo, shirt, looking at viewer, skirt, hair between eyes, standing, asymmetrical bangs, closed mouth, ponytail, cowboy shot, bangs, orange hair, jewelry, necklace | |
| FREDERICA MIYAMOTO, | |
| multiple girls, 2girls, jewelry, smile, green eyes, open mouth, blonde hair, brown hair, short hair, earrings, gloves, lace gloves, long hair, hair ornament, black gloves, breasts, black dress, bangs, dress, looking at viewer | |
| SHIKI ICHINOSE, | |
| multiple girls, dress, ahoge, red dress, smile, jewelry, blue eyes, green hair, long hair, earrings, sleeveless dress, gloves, breasts, black dress, brown hair, bangs, medium breasts, wavy hair, sleeveless, bare shoulders | |
| ``` | |
| As a bonus, some [Cinderella Girls](https://civitai.com/models/23476/) prompts work as well. | |
| ## Training info | |
| Training info | |
| Dataset: | |
| * 3636 Theater days cards collected from [Fantasia](https://mltd.matsurihi.me/) (wide images excluded) | |
| Tags generated with [SmilingWolf/wd-v1-4-convnextv2-tagger-v2](https://huggingface.co/SmilingWolf/wd-v1-4-convnextv2-tagger-v2) with a threshold of 0.35. No balancing and tag cleaning. No distinction between Produce and Support cards. | |
| Inspired by [a 2022 paper](https://openreview.net/pdf?id=Uad23IcIEs), a custom LR scheduler was used: | |
| ``` | |
| SequentialLR(optimizer, [ | |
| LinearLR(optimizer, 0.1, total_iters=steps_per_epoch), | |
| CosineAnnealingWarmRestarts(optimizer, steps_per_epoch*2, T_mult=2) | |
| ], [steps_per_epoch]) | |
| ``` | |
| Training cost: ~31 T4-hours (in addition to deresute costs) | |
| Data distribution: | |
| ``` | |
| character cards | |
| 1 YURIKO NANAO 80 | |
| 2 MATSURI TOKUGAWA 80 | |
| 3 ARISA MATSUDA 78 | |
| 4 MIRAI KASUGA 78 | |
| 5 KANA YABUKI 78 | |
| 6 EMILY STEWART 76 | |
| 7 SHIHO KITAZAWA 76 | |
| 8 UMI KOUSAKA 76 | |
| 9 SERIKA HAKOZAKI 76 | |
| 10 TSUBASA IBUKI 76 | |
| 11 JULIA 74 | |
| 12 REIKA KITAKAMI 74 | |
| 13 TOMOKA TENKUBASHI 74 | |
| 14 SHIZUKA MOGAMI 74 | |
| 15 ANNA MOCHIZUKI 74 | |
| 16 KOTOHA TANAKA 74 | |
| 17 MOMOKO SUOU 72 | |
| 18 MIZUKI MAKABE 72 | |
| 19 KONOMI BABA 72 | |
| 20 HINATA KINOSHITA 72 | |
| 21 AYUMU MAIHAMA 72 | |
| 22 SAYOKO TAKAYAMA 72 | |
| 23 ROCO HANDA 72 | |
| 24 MEGUMI TOKORO 72 | |
| 25 ELENA SHIMABARA 72 | |
| 26 SUBARU NAGAYOSHI 70 | |
| 27 MIYA MIYAO 70 | |
| 28 IKU NAKATANI 70 | |
| 29 AKANE NONOHARA 70 | |
| 30 RIO MOMOSE 68 | |
| 31 KAREN SHINOMIYA 68 | |
| 32 FUKA TOYOKAWA 68 | |
| 33 TAMAKI OGAMI 68 | |
| 34 MINAKO SATAKE 68 | |
| 35 CHIHAYA KISARAGI 68 | |
| 36 CHIZURU NIKAIDO 66 | |
| 37 NAO YOKOYAMA 66 | |
| 38 RITSUKO AKIZUKI 66 | |
| 39 MIKI HOSHII 66 | |
| 40 HARUKA AMAMI 64 | |
| 41 NORIKO FUKUDA 64 | |
| 42 AZUSA MIURA 64 | |
| 43 MAMI FUTAMI 64 | |
| 44 TAKANE SHIJOU 64 | |
| 45 IORI MINASE 64 | |
| 46 MAKOTO KIKUCHI 62 | |
| 47 YAYOI TAKATSUKI 60 | |
| 48 KAORI SAKURAMORI 60 | |
| 49 HIBIKI GANAHA 60 | |
| 50 YUKIHO HAGIWARA 60 | |
| 51 TSUMUGI SHIRAISHI 56 | |
| 52 AMI FUTAMI 56 | |
| 53 SHIKA 8 | |
| 54 LEON 8 | |
| 55 FREDERICA MIYAMOTO 2 | |
| 56 SHIKI ICHINOSE 2 | |
| ``` | |
| ``` | |
| [model_arguments] | |
| v2 = false | |
| v_parameterization = false | |
| pretrained_model_name_or_path = "animefull-final-pruned.ckpt" | |
| [additional_network_arguments] | |
| no_metadata = false | |
| network_module = "lycoris.kohya" | |
| network_dim = 16 | |
| network_alpha = 1 | |
| network_args = [ "conv_dim=0", "algo=loha",] | |
| network_train_unet_only = false | |
| network_train_text_encoder_only = false | |
| cache_latents = false | |
| [optimizer_arguments] | |
| optimizer_type = "AdamW8bit" | |
| learning_rate = 0.001 | |
| max_grad_norm = 1.0 | |
| lr_scheduler = "custom" | |
| #lr_warmup_steps = 100 | |
| [dataset_arguments] | |
| debug_dataset = false | |
| # resolution: 576x704 | |
| [training_arguments] | |
| save_precision = "fp16" | |
| save_every_n_epochs = 1 | |
| max_token_length = 225 | |
| mem_eff_attn = false | |
| xformers = true | |
| max_train_epochs = 31 | |
| max_data_loader_n_workers = 0 | |
| persistent_data_loader_workers = false | |
| gradient_checkpointing = false | |
| gradient_accumulation_steps = 1 | |
| mixed_precision = "fp16" | |
| clip_skip = 2 | |
| lowram = true | |
| [sample_prompt_arguments] | |
| [saving_arguments] | |
| save_model_as = "safetensors" | |
| ``` | |
| v2.1 is tuned from v2.0 with resolution raised to 640x768. | |