flux-RealismLora / README.md
anghellia's picture
Small spelling correction (#13)
1965e17 verified
metadata
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.
language:
  - en
pipeline_tag: text-to-image
tags:
  - lora
  - Stable Diffusion
  - image-generation
  - Flux
  - diffusers
base_model: black-forest-labs/FLUX.1-dev

Lora Photorealism for Flux

This repository provides a checkpoint with trained LoRA photorealism for FLUX.1-dev model by Black Forest Labs

Example Picture 1

ComfyUI

See our github for comfy ui workflows. Example Picture 1

Training details

XLabs AI team is happy to publish fine-tuning Flux scripts, including:

  • LoRA πŸ”₯
  • ControlNet πŸ”₯

See our github for train script and train configs.

Training Dataset

Dataset has the following format for the training process:

β”œβ”€β”€ images/
β”‚    β”œβ”€β”€ 1.png
β”‚    β”œβ”€β”€ 1.json
β”‚    β”œβ”€β”€ 2.png
β”‚    β”œβ”€β”€ 2.json
β”‚    β”œβ”€β”€ ...

A .json file contains "caption" field with a text prompt.

Inference

python3 demo_lora_inference.py \
    --checkpoint lora.safetensors \
    --prompt " handsome girl in a suit covered with bold tattoos and holding a pistol. Animatrix illustration style, fantasy style, natural photo cinematic"

Example Picture 1

License

lora.safetensors falls under the FLUX.1 [dev] Non-Commercial License