May I ask how did you make Lora realize multiple concepts, and do not express at all without entering a specific prompt?

#5
by joushe - opened

I am amazed by the lora model you made, the model has such a strong grip on the concept
May I ask that all similar pictures are manually labeled on a purpose to let lora have these concepts?

I don't understand what you mean by multiple concepts here. All LoRAs that are on here for now are only single subject which is a certain character.
The reason they are not expressed without providing long prompt because I didn't prune the tags during training. Let's say your character has yellow eyes. If you wanted to generate her having yellow eyes always without prompting specificly for yellow eyes, during training you would remove this tag from the image description so AI knows that yellow eyes are something that is vital to the image. If you don't remove them, you are basically telling AI that it has yellow eyes, but it is not something that it should learn by heart.
Here is a example of a character that tags like eyes, horns, hair etc.. were pruned. You can see that without prompting you can get the character's looks because AI learned that those things are vital to the image.
( can't post full picutre because it is bit nsfw )
chrome_tUMMZlZm2y.png
I Trained a multi subject model and LoRA before, my KOTE model is a example of a multi subject Model that can produce multiple subjects and a artstyle.

That's it, thank you for your help, can you show me some of your annotations and comparison pictures, I want to be a reference

I don't understand the question. You want to see comparison between pruned and unpruned LoRA?

Thank you for your reply, sorry my presentation was a bit bad i wasted your time, I am referring to a part of the prompt label and the example picture compared with it, like this
example.png

I don't share my training data.
Example of a pruned subject LoRA:
mona (genshin impact), 1girl, hat, solo, ass, witch hat, pantyhose, leotard, gloves, looking at viewer, water, looking back, from behind, thighlet, gold trim, black gloves, jewelry, open mouth, earrings, detached sleeves, bodystocking, cape, blue leotard, fur collar, elbow gloves, brown pantyhose, hat ornament, star (symbol), thighs
Example of a unpruned subject LoRA:
eula (genshin impact), 1girl, solo, thighhighs, weapon, sword, breasts, necktie, hairband, boots, holding, sitting, leotard, bangs, thighs, shirt, cape, blue hair, blue necktie, long sleeves, looking at viewer, white background, thigh boots, simple background, hair ornament, high heels, black footwear, holding sword, holding weapon, medium breasts, knee up, black thighhighs, yellow eyes, black hairband, high heel boots, black leotard, puffy sleeves, medium hair, closed mouth, arm support, purple eyes, vision (genshin impact), long hair, white shirt, hair between eyes, juliet sleeves
Example of a style LoRA:
1girl, solo, dress, bracelet, jewelry, choker, jacket, magic, braid, makeup, glowing, ribbon, breasts, lipstick, bangle, lips, long hair, green eyes, upper body, green hair, brown hair, parted lips, cropped jacket, white dress, small breasts, black hair, light particles

YoungMasterFromSect changed discussion status to closed

Sign up or log in to comment