File size: 7,151 Bytes
c3c6a96 fabb5ac c3c6a96 3027cc3 c3c6a96 0603e82 9ddb42a c3c6a96 9ddb42a c3c6a96 39af87d 4d406b4 c3c6a96 0603e82 32b5589 c3c6a96 32b5589 c3c6a96 32b5589 c3c6a96 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 |
---
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.
language:
- en
pipeline_tag: text-to-image
tags:
- LoRA
- Stable Diffusion
- image-generation
- Flux
---
This repository provides a checkpoint with trained LoRAs for
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs
[<img src="https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/join-our-discord-rev1.png?raw=true">](https://discord.gg/FHY2guThfy)
# ComfyUI
[See our github](https://github.com/XLabs-AI/x-flux-comfyui) for comfy ui workflows.
# Training details
[XLabs AI](https://github.com/XLabs-AI) team is happy to publish fune-tuning Flux scripts, including:
- **LoRA** 🔥
- **ControlNet** 🔥
[See our github](https://github.com/XLabs-AI/x-flux) for train script and train configs.
# Training Dataset
Dataset has the following format for the training process:
```
├── images/
│ ├── 1.png
│ ├── 1.json
│ ├── 2.png
│ ├── 2.json
│ ├── ...
```
A .json file contains "caption" field with a text prompt.
Thank https://civitai.com/user/dobrosketchkun and https://civitai.com/user/sadxzero for datasets for loras
# Inference
## furry_lora
```bash
python3 main.py \
--prompt "Female furry Pixie with text 'hello world'" \
--lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
--model_type flux-dev-fp8 --width 1024 --height 1024 \
--timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5 --guidance 4
```
```bash
python3 main.py \
--prompt "Male furry Lycanthrope with fur-covered body in ancient ruins, howling at the full moon, surrounded by eerie mist, werewolf transformation, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
--lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
--model_type flux-dev-fp8 --width 1024 --height 1024 \
--timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5
```
## mjv6_lora
```bash
python3 main.py \
--prompt "A handsome man in a suit, 25 years old, cool, futuristic" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name mjv6_lora.safetensors \
--device cuda:4 --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
```bash
python3 main.py \
--prompt "A girl in a suit covered with bold tattoos and holding a vest pistol, beautiful woman, 25 years old, cool, future fantasy, turquoise & light orange ping curl hair" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name mjv6_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
## anime_lora
```bash
python3 main.py \
--prompt "A cute corgi lives in a house made out of sushi, anime" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name anime_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
```bash
python3 main.py \
--prompt "a girl with orange hair, standing in a room with a window, looking out at a cityscape, anime" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name anime_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
## disney_lora
```bash
python3 main.py \
--prompt "An aerial view of beach with people on it, disney style" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name disney_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
```bash
python3 main.py \
--prompt "A blue jay standing on a large basket of rainbow macarons, disney style" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name disney_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
## scenery_lora
```bash
python3 main.py \
--prompt "A fantasy cityscape with multiple buildings and skyscrapers all of which are covered in snow and ice, scenery style" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name scenery_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
```bash
python3 main.py \
--prompt "A large ornate building with multiple levels and arches surrounded by trees and greenery. In front of it there are several statues and sculptures on pedestals with fire burning brightly in front of them, scenery style" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name scenery_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
## art_lora
```bash
python3 main.py \
--prompt "white rabbit in blue dress and hat holding bow and arrow, art" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name art_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
```bash
python3 main.py \
--prompt "castle in the middle of forest at night, art" \
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name art_lora.safetensors \
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
```
# License
lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/> |