|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
base_model: black-forest-labs/FLUX.1-schnell |
|
pipeline_tag: text-to-image |
|
tags: |
|
- flux |
|
- lora |
|
- image-generation |
|
- diffusers |
|
--- |
|
|
|
LoRA checkpoint aiming to improve [FLUX.1 [schnell]](https://huggingface.co/black-forest-labs/FLUX.1-schnell) photorealism. |
|
|
|
**The weights are provided as `.safetensors` file**, so they are suited for every use-cases, including but not limited to: |
|
- SD-WebUI |
|
- ComfyUI |
|
- InvokeAI |
|
- Forge |
|
- ... |
|
|
|
# Training details |
|
This checkpoint has been trained with a fairly small dataset of 100+ synthetic images generated and upscaled using [Runtime44](https://runtime44.com) |
|
All images have been manually captionned **without** any specific trigger word. |
|
|
|
Training was done using [kohya-ss scripts](https://github.com/kohya-ss/sd-scripts) on a local machine with 16Gb of VRAM and took ~1h |
|
|
|
|
|
|
|
# Usage |
|
|
|
## With [🧨Diffusers](https://huggingface.co/docs/diffusers/en/index) library |
|
|
|
```python |
|
from diffusers import AutoPipelineForText2Image |
|
import torch |
|
|
|
pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-schnell', torch_dtype=torch.bfloat16).to('cuda') |
|
pipeline.load_lora_weights('hugovntr/flux-schnell-realism', weight_name='schnell-realism_v1') |
|
image = pipeline('Moody kitchen at dusk, warm golden ...').images[0] |
|
image.save("output.png") |
|
``` |