Krea 2 Turbo bitsandbytes NF4

bf16 vs NF4 comparison

Left: original bf16  路  Right: this NF4 model (same prompt and seed).

This is an NF4 (4-bit NormalFloat) quantized version of krea/Krea-2-Turbo using bitsandbytes.

Note: You need bitsandbytes installed

Usage

You can find ready-to-use scripts in the diffusers-recipes repository.

Sample image

The quantized (right) image above was generated with the following prompt and settings (seed 7):

import torch
from diffusers import DiffusionPipeline

pipe = DiffusionPipeline.from_pretrained("OzzyGT/Krea_2_Turbo_bnb_nf4", torch_dtype=torch.bfloat16)
pipe.to("cuda")

prompt = (
    "A cozy corner bookstore-cafe on a rainy evening, cinematic wide shot. "
    'A large hand-lettered chalkboard sign in the window reads "FRESH COFFEE & OLD BOOKS" '
    "and below it in smaller chalk letters \"open 'til late\". "
    "Warm golden light spills onto wet cobblestones that mirror pink and blue neon reflections. "
    "Inside, tall mahogany shelves are packed with hundreds of colorful book spines with tiny legible titles, "
    "a barista in a striped apron pours delicate latte art, steam curling upward, "
    "a tabby cat sleeps on a windowsill beside a stack of paperbacks. "
    "Intricate detail, sharp focus, shallow depth of field, photorealistic, rich color grading."
)

image = pipe(
    prompt,
    num_inference_steps=8,
    guidance_scale=0.0,
    height=1024,
    width=1024,
    generator=torch.Generator("cuda").manual_seed(7),
).images[0]
image.save("sample.png")
Downloads last month
42
Safetensors
Model size
7B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for OzzyGT/Krea_2_Turbo_bnb_nf4

Base model

krea/Krea-2-Raw
Quantized
(25)
this model