metadata

tags:
  - text-to-image
  - stable-diffusion
  - lora
  - diffusers
  - template:sd-lora
widget:
  - text: pastel drawing of factorio, symetry
    output:
      url: images/pastel_00329_71531_Pastel drawing of factorio, symetry.png
  - text: factorio, pattern
    output:
      url: images/texture_00240_01971_factorio, pattern.png
  - text: factorio by Goya
    output:
      url: images/abstract_painting_00116_40985_factorio by Goya.png
  - text: factorio
    output:
      url: images/abstract_painting_00000_86389_factorio.png
  - text: factorio, fractals
    output:
      url: images/abstract_lines_00039_48448_factorio, fractals.png
  - text: pastel drawing of factorio
    output:
      url: images/00019_23936_Pastel drawing of factorio.png
  - text: factorio, pixel art, 8-bit colors
    output:
      url: images/00088_97924_factorio, pixel art, 8-bit colors.png
  - text: Patent drawing of factorio
    output:
      url: images/00008_06084_Patent drawing of factorio.png
base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: factorio
license: cc0-1.0
datasets:
  - piebro/factorio-blueprint-visualizations

Factorio

Prompt
factorio, pixel art, 8-bit colors

Model description

Create abstract art in the style of artfully visualized Factorio blueprints. This Lora is trained using this dataset: https://huggingface.co/datasets/piebro/factorio-blueprint-visualizations.

Trigger words

You should use factorio to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Replication

This is the command I used using for training the lora, using this file.

accelerate launch train_dreambooth_lora_sdxl.py --pretrained_model_name_or_path=stabilityai/stable-diffusion-xl-base-1.0 --pretrained_vae_model_name_or_path=madebyollin/sdxl-vae-fp16-fix --instance_data_dir=factorio_lora_images --instance_prompt='factorio' --output_dir=factorio_lora --seed=0 --resolution=1024 --train_batch_size=2 --max_train_steps=500 --checkpointing_steps=100 --gradient_accumulation_steps=2 --gradient_checkpointing --learning_rate=1e-4 --lr_scheduler=constant --lr_warmup_steps=0 --use_8bit_adam --mixed_precision=fp16

Usage

import torch
from diffusers import DiffusionPipeline, AutoencoderKL
device = "cuda" if torch.cuda.is_available() else "cpu"
vae = AutoencoderKL.from_pretrained('madebyollin/sdxl-vae-fp16-fix', torch_dtype=torch.float16)
pipe = DiffusionPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
    vae=vae, torch_dtype=torch.float16, variant="fp16",
    use_safetensors=True
)
pipe.to(device)
# This is where you load your trained weights
specific_safetensors = "pytorch_lora_weights.safetensors"
lora_scale = 0.9
pipe.load_lora_weights(
    'piebro/factorio-blueprint-visualizations-sdxl-lora', 
    weight_name = specific_safetensors,
)
prompt = "pastel drawing of factorio"
image = pipe(
    prompt=prompt, 
    num_inference_steps=50,
    cross_attention_kwargs={"scale": lora_scale}
).images[0]

List of Example Prompts

lines

Patent drawing of factorio
graphite sketch of factorio
factorio, detailed architectural blueprint style
factorio, intricate pen and ink line art
factorio in a detailed scientific illustration style
factorio, concept sketch
factorio, scientific illustration
Technical schematic of factorio in the style of a detailed patent drawing
factorio depicted in a detailed architectural blueprint style, with precise measurements and labels
factorio in a minimalist, line art drawing

special

charcoal drawing of factorio
factorio in watercolor style
factorio, ball-point pen art
factorio visualized in a moody chiaroscuro ink drawing
factorio in a neon-lit digital cyberpunk art style
factorio, Art Deco-style geometric pattern design
factorio in a futuristic, sci-fi digital art concept
factorio, pixel art
factorio, pixel art, 8-bit colors
factorio, retro 1980s style digital pixel art
factorio by Rothko
factorio by Klimt
factorio by Ai Weiwei

normal

factorio
a texture of factorio
Pastel drawing of factorio
Pastel drawing of factorio, symetry
factorio, symetry
factorio, fractals
factorio, pattern
factorio, geometric pattern design
factorio, design
factorio, acrylic paint
factorio, Comic Book
factorio rendered in a photorealistic digital art style
factorio, vintage
factorio by Goya