gradient-diffusion
commited on
Commit
β’
c3c6a96
1
Parent(s):
78eaa86
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: flux-1-dev-non-commercial-license
|
4 |
+
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
pipeline_tag: text-to-image
|
8 |
+
tags:
|
9 |
+
- LoRA
|
10 |
+
- Stable Diffusion
|
11 |
+
- image-generation
|
12 |
+
- Flux
|
13 |
+
---
|
14 |
+
![Lora Photorealism for Flux](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/lora-photorealism-header-rev1.png?raw=true)
|
15 |
+
|
16 |
+
This repository provides a checkpoint with trained LoRAs for
|
17 |
+
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs
|
18 |
+
|
19 |
+
![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/picture-6-rev1.png?raw=true)
|
20 |
+
|
21 |
+
# Training details
|
22 |
+
[XLabs AI](https://github.com/XLabs-AI) team is happy to publish fune-tuning Flux scripts, including:
|
23 |
+
|
24 |
+
- **LoRA** π₯
|
25 |
+
- **ControlNet** π₯
|
26 |
+
|
27 |
+
[See our github](https://github.com/XLabs-AI/x-flux) for train script and train configs.
|
28 |
+
|
29 |
+
# Training Dataset
|
30 |
+
Dataset has the following format for the training process:
|
31 |
+
|
32 |
+
```
|
33 |
+
βββ images/
|
34 |
+
β βββ 1.png
|
35 |
+
β βββ 1.json
|
36 |
+
β βββ 2.png
|
37 |
+
β βββ 2.json
|
38 |
+
β βββ ...
|
39 |
+
```
|
40 |
+
A .json file contains "caption" field with a text prompt.
|
41 |
+
|
42 |
+
# Inference
|
43 |
+
#
|
44 |
+
```bash
|
45 |
+
python3 main.py \
|
46 |
+
--prompt "A handsome man in a suit, 25 years old, cool, futuristic" \
|
47 |
+
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name mjv6_lora.safetensors \
|
48 |
+
--device cuda:4 --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024
|
49 |
+
```
|
50 |
+
|
51 |
+
![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/result_13.png?raw=true)
|
52 |
+
|
53 |
+
|
54 |
+
# License
|
55 |
+
|
56 |
+
lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/>
|