irodkin/celeba_with_llava_captions
Viewer • Updated • 36.6k • 39 • 3
How to use Catniti/catrex-1.0-image with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("Catniti/catrex-1.0-image", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]Text-to-image model for face generation, fine-tuned on 20,000 captioned portraits.
| Metric | Value |
|---|---|
| MSE loss | 0.1678 |
| Resolution | 192x192 |
| UNet parameters | 323M |
| Training steps | 500 |
| Base model | segmind/tiny-sd |
from diffusers import StableDiffusionPipeline
import torch
pipe = StableDiffusionPipeline.from_pretrained(
"Catniti/catrex-1.0-image", torch_dtype=torch.float16, safety_checker=None
).to("cuda")
image = pipe(
"a photo of a young woman with long blonde hair, smiling",
num_inference_steps=30,
guidance_scale=7.5,
height=192, width=192,
).images[0]
image.save("face.png")
Plain English descriptions of a person: gender, age, hair, expression.
a photo of an older man with a grey beard and glasses
Trained only on portraits, so it generates faces regardless of the prompt — ask for a landscape and you still get a face. Best results at 192x192; higher resolutions degrade.