CharHelper / README.md
ManglerFTW's picture
Update README.md
4a54375
|
raw
history blame
21.8 kB
metadata
license: creativeml-openrail-m
tags:
  - stable-diffusion
  - text-to-image

Introduction:

This model was trained on a digital painting style mainly with characters and portraits. The main objective is to train a model to be a tool to help with character design ideas. It's base is Stable Diffusion V2.1 and is trained with 768X768 images. You will need to add the .yaml file into the same directory as your model to use.

V3:

File Name is CharHelperV3.ckpt

Completely retrained from the begining in a fundamentally different process from CharHelper V1 and 2. This new model is much more diverse in range and can output some amazing results.

It was trained on multiple subjects and styles including buildings, vehicles, and landscapes as well.

Usage

This model has multiple keywords that can be mixed and matched together in order to acheive a multitude of different styles. However, keywords aren't necessarily needed but can help with styling.

Keywords:

Character Styles: CHV3CKnight, CHV3CWizard, CHV3CBarb, CHV3MTroll, CHV3MDeath, CHV3CRogue, CHV3CCyberpunk, CHV3CSamurai, CHV3CRobot

Scenery/Landscapes: CHV3SWorld, CHV3SSciFi

WIPs (needs fine-tuning, but try it out): CHV3MDragon, CHV3CVehicle

Mix & Match Styles: X/Y Grid

Mix & Match "CHV3CCyberpunk.grim reaper"

A realistic detail of a mid-range, full-torso, waist-up character portrait of a (CHV3CCyberpunk.grim reaper) costume with beautiful artistic scenery in the background, trending on artstation, 8k, hyper detailed, artstation, concept art, hyper realism, ultra-real, digital painting, cinematic, art award, highly detailed, attractive face, professional hands, professional anatomy, (2 arms, 2 hands)

Negative prompt: NegLowRes-2400, NegMutation-500, amateur, ((extra limbs)), ((extra barrel)), ((b&w)), ((close-up)), (((duplicate))), ((mutilated)), extra fingers, mutated hands, (((deformed))), blurry, (((bad proportions))), ((extra limbs)), cloned face, out of frame, extra limbs, gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (tripod), (tube), ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, (umbrella), weapon, sword, dagger, katana, cropped head

Steps: 10, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 1840075390, Size: 768x896, Model hash: cba4df56, ENSD: 3

Works with embeddings: X/Y Grid E

Mix & Match "."in the beginning with embedding keywords

., CHV3CWizard, modelshoot style mid-range character detail of a beautiful young adult woman wearing an intricate sorceress gown (casting magical spells under the starry night sky), 23 years old, magical energy, trending on artstation, 8k, hyper detailed, artstation, hyper realism, ultra-real, commissioned professional digital painting, cinematic, art award, highly detailed, attractive face, professional anatomy, (2 professional arms, 2 professional hands), artwork by Leonardo Davinci

Negative prompt: amateur, ((extra limbs)), ((extra barrel)), ((b&w)), ((close-up)), (((duplicate))), ((mutilated)), extra fingers, mutated hands, (((deformed))), blurry, (((bad proportions))), ((extra limbs)), cloned face, out of frame, extra limbs, gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (tripod), (tube), ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, crossed eyes, dead eyes, body out of frame, blurry, bad art, bad anatomy, (umbrella), weapon, sword, dagger, katana, cropped head

Steps: 40, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 2891848182, Size: 768x896, Model hash: cba4df56, ENSD: 3

Character Examples

Magical Sorceress

Magical Sorceress

., CHV3CWizard, CHV3CBarb, modelshoot style mid-range close-up of a beautiful young adult woman wearing an intricate sorceress gown casting magical spells under the starry night sky, magical energy, trending on artstation, 8k, hyper detailed, artstation, hyper realism, ultra-real, commissioned professional digital painting, cinematic, art award, highly detailed, attractive face, professional anatomy, (2 professional arms, 2 professional hands), artwork by Leonardo Davinci

Negative prompt: amateur, ((extra limbs)), ((extra barrel)), ((b&w)), ((close-up)), (((duplicate))), ((mutilated)), extra fingers, mutated hands, (((deformed))), blurry, (((bad proportions))), ((extra limbs)), cloned face, out of frame, extra limbs, gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (tripod), (tube), ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, (umbrella), weapon, sword, dagger, katana, cropped head

Steps: 10, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 3460729168, Size: 768x896, Model hash: cba4df56, ENSD: 3

Female Death Troll

Female Death Troll

a (mid-range) portrait of an ugly green-skinned female Death Troll in a Samurai outfit in a dark spooky forest, cinematic, high detail, artwork by wlop, and loish, Professional, masterpiece, commissioned, (attractive face), facial expression, 4k, polycount contest winner, trending on artstation, professional hands, professional anatomy, 2 arms and 2 legs, CHV3CSamurai, CHV3MTroll, CHV3MDeath, Artwork by Leonardo Davinci, Frank Frazetta, Loish and Wlop

Negative prompt: NegLowRes-2400, NegMutation-500, ((disfigured)), ((bad art)), ((deformed)),((extra limbs)), ((extra barrel)),((close up)),((b&w)), weird colors, blurry, (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (((tripod))), (((tube))), Photoshop, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, (((umbrella)))

Steps: 10, Sampler: DPM++ SDE, CFG scale: 9, Seed: 1999542482, Size: 768x896, Model hash: cba4df56, ENSD: 3

Astronaut

Astronaut

A realistic detail of a character portrait of a person in a(n) (CHV3CCyberpunk.astronaut) costume with beautiful scenery in the background, trending on artstation, 8k, hyper detailed, artstation, full body frame, complete body, concept art, hyper realism, ultra real, watercolor, cinematic, art award, highly detailed, attractive face, facial expression, professional hands, professional anatomy, 2 arms and 2 legs

Negative prompt: NegLowRes-2400, NegMutation-500, ((disfigured)), ((bad art)), ((deformed)),((extra limbs)), ((extra barrel)),((close up)),((b&w)), weird colors, blurry, (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (((tripod))), (((tube))), Photoshop, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, (((umbrella)))

Steps: 40, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 1369534527, Size: 768x896, Model hash: cba4df56, ENSD: 3

Cyberpunk Grim Reaper

Cyberpunk Grim Reaper

A realistic detail of a (mid-range) full torso character portrait of a(n) (CHV3CCyberpunk.grim reaper) costume with artistic scenery in the background, trending on artstation, 8k, hyper detailed, artstation, concept art, hyper realism, ultra-real, digital oil painting, cinematic, art award, highly detailed, attractive face, facial expression, professional hands, professional anatomy, 2 arms

Negative prompt: NegLowRes-2400, NegMutation-500, amateur, ((extra limbs)), ((extra barrel)), ((b&w)), close-up, (((duplicate))), ((mutilated)), extra fingers, mutated hands, (((deformed))), blurry, (((bad proportions))), ((extra limbs)), cloned face, out of frame, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (tripod), (tube), ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, (umbrella), weapon

Steps: 10, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 1823979933, Size: 768x896, Model hash: cba4df56, ENSD: 3

>Beautiful Sorceress

Beautiful Sorceress

., CHV3CWizard, a close-up:.4 of a beautiful woman wearing an intricate sorceress gown casting magical spells under the starry night sky, magical energy, trending on artstation, 8k, hyper detailed, artstation, concept art, hyper realism, ultra-real, digital painting, cinematic, art award, highly detailed, attractive face, professional hands, professional anatomy, (2 arms, 2 hands)

Negative prompt: NegLowRes-2400, NegMutation-500, amateur, ((extra limbs)), ((extra barrel)), ((b&w)), ((close-up)), (((duplicate))), ((mutilated)), extra fingers, mutated hands, (((deformed))), blurry, (((bad proportions))), ((extra limbs)), cloned face, out of frame, extra limbs, gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (tripod), (tube), ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, (umbrella), weapon, sword, dagger, katana, cropped head

Steps: 10, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 785469078, Size: 768x896, Model hash: cba4df56, ENSD: 3

>Tiger

It does well with some animals

mid-range modelshoot style detail, (extremely detailed 8k wallpaper), A detailed portrait of an anthropomorphic furry tiger in a suit and tie, by justin gerard and greg rutkowski, digital art, realistic painting, dnd, character design, trending on artstation, Smoose2, CHV3CBarb

Negative prompt: NegLowRes-2400, NegMutation-500, 3d, 3d render, b&w, bad anatomy, bad anatomy, bad anatomy, bad art, bad art, bad proportions, blurry, blurry, blurry, body out of frame, canvas frame, cartoon, cloned face, close up, cross-eye, deformed, deformed, deformed, disfigured, disfigured, disfigured, duplicate, extra arms, extra arms, extra fingers, extra legs, extra legs, extra limbs, extra limbs, extra limbs, extra limbs, fused fingers, gross proportions, long neck, malformed limbs, missing arms, missing legs, morbid, mutated, mutated hands, mutated hands, mutation, mutation, mutilated, out of frame, out of frame, out of frame, Photoshop, poorly drawn face, poorly drawn face, poorly drawn feet, poorly drawn hands, poorly drawn hands, tiling, too many fingers

Steps: 30, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 1989203255, Size: 768x896, Model hash: cba4df56, ENSD: 3

Other Examples

Check out CHV3SSciFi, CHV3SWorld, and CHV3CVehicle for non character images

>Church in CHV3MDeath Styling

Church in CHV3MDeath Styling

a ((((toon)))) style detail of a ((fantasy, ((((cartoon)))) gothic church with beautiful landscaping in a dense forest, in the style of CHV3SWorld and CHV3MDeath)) [ :, ((thick black ink outlines)), ((((penned lines, flat shading, doodled lines)))), anime style illustration, dofus style, stylized, digital painting, high detail, professional, masterpiece, Artwork by studio ghibli and Shigeru Miyamoto:.15]

Negative prompt: NegLowRes-2400, NegMutation-500, disfigured, distorted face, mutated, malformed, poorly drawn, ((odd proportions)), noise, blur, missing limbs, ((ugly)), text, logo, over-exposed, over-saturated, over-exposed, ((over-saturated))

Steps: 35, Sampler: Euler a, CFG scale: 13.5, Seed: 631476138, Size: 1024x768, Model hash: cba4df56, Denoising strength: 0.7, ENSD: 3, First pass size: 768x768

>A group of people looking as a space ship

A group of people looking as a space ship

CHV3CVehicle, an artistic detail of a man standing on top of a lush green field with a giant spaceship in the sky, by Christopher Balaskas, retrofuturism, retro spaceships parked outside, beeple and jeremiah ketner, shipfleet on the horizon, palace floating in the sky, lucasfilm jesper ejsing, of a family leaving a spaceship, highly detailed fantasy art, bonestell, stålenhag, trending on artstation, 8k, hyper detailed, artstation, hyper realism, ultra-real, commissioned professional digital painting, cinematic, art award, highly detailed, attractive face, professional anatomy, (2 professional arms, 2 professional hands), artwork by Leonardo Davinci

Negative prompt: amateur, ((extra limbs)), ((extra barrel)), ((b&w)), ((close-up)), (((duplicate))), ((mutilated)), extra fingers, mutated hands, (((deformed))), blurry, (((bad proportions))), ((extra limbs)), cloned face, out of frame, extra limbs, gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), (tripod), (tube), ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, crossed eyes, dead eyes, body out of frame, blurry, bad art, bad anatomy, (umbrella), weapon, sword, dagger, katana, cropped head

Steps: 40, Sampler: DPM++ SDE Karras, CFG scale: 9, Seed: 2722466703, Size: 768x896, Model hash: cba4df56, ENSD: 3


V2:

Trained for an additional 5000 steps. Results will be much more stable and major improvement over V1. Don't forget to add the yaml file into your models directory.

V2 checkpoint filename is CharHelper_v2_ SDv2_1_768_step_8500.ckpt

Usage

This model tends to like the higher CFG scale range. 7-15 will bring good results. Images come out well if they are 756X756 resolution size and up.

A good prompt to start with is:

(a cyberpunk rogue), charhelper, ((close up)) portrait, digital painting, artwork by leonardo davinci, high detail, professional, masterpiece, anime, stylized, face, facial expression, inkpunk, professional anatomy, professional hands, anatomically correct, colorful

Negative: ((bad hands)), disfigured, distorted face, mutated, malformed, bad anatomy, mutated feet, bad feet, poorly drawn, ((odd proportions)), noise, blur, missing fingers, missing limbs, long torso, ((ugly)), text, logo, over-exposed, over-saturated, ((bad anatomy)), over-exposed, ((over-saturated)), (((weapon))), long neck, black & white, ((glowing eyes))

Just substitute what's in the beginning parenthesis with your subject. You can also substitute "((close up))" with "((mid range))" as well. These worked best for me, but I'm excited to see what everyone else can do with it.

Examples

Below are some examples of images generated using this model:

A Woman with Los Muertos Skull Facepaint: Woman with Los Muertos Skull Facepaint

Rugged Samurai Man: Rugged Samurai Man

Space Girl: Space Girl

Raver Girl with HeadPhones: Raver Girl

CyberPunk Rogue: CyberPunk Rogue

Toon Animal: Toon Animal

Female Astronaut: Female Astronaut

Japanese Samurai: Japanese Samurai

Bell Head: Bell Head

Native American Chief: Native American Chief

CyberPunk Buddha: CyberPunk Buddha

Alien Boy: Alien Boy

Los Muertos Facepaint 2: Los Muertos Facepaint 2

Robot Fighter: Robot Fighter

Video Game Elf Character: Video Game Elf Character

V1:

Trained for 3500 steps on SD v2.1 using TheLastBen's Fast Dreambooth. Usage: Use CharHelper in prompt to bring out the style. Other prompts that work well are 'Character Art', 'Close-up/Mid-range Character portrait', 'Digital Painting', Digital Illustration', 'Stylized', and 'anime'.

Still needs work with anatomy and full body images may need inpainting to fix faces but there are plans to fine-tune the model further in hopes to improve functionality.