---
tags:
- text-to-image
- stable-diffusion
- lora
- diffusers
widget:
- text: >-
    a front right right view of a normal map of a high quality 3D model of a
    croissant, flaky, buttery, freshly baked, delicious, breakfast pastry.
    normal map
  output:
    url: images/00016-generated-56421668267.png
- text: >-
    a front right view of a albedo map of a high quality 3D model of a
    croissant, flaky, buttery, freshly baked, delicious. VAR2, colormap, muted
    realistic colors
  output:
    url: images/00017-generated-56421668268.png
- text: >-
    a front right view of a ambient occlusion map of a high quality 3D model of
    a croissant, flaky pastry, buttery, delicious, freshly baked, traditional
    french pastry. black and white, ambmap
  output:
    url: images/00018-generated-56421668269.png
- text: >-
    a front right view of a roughness map of a high quality 3D model of a
    croissant, flaky, buttery, freshly baked, delicious, French pastry,
    breakfast food,. black and white, small roughness variations, roughmap
  output:
    url: images/00019-generated-56421668270.png
base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: heighmap, colormap, roughmap, normalmap, specmap, ambmap
license: apache-2.0
language:
- en
---
# Material Synthesis With SDXL

NOTE: The Inference API uses the 3D model by default, so if you want to generate 2D textures you may want to clone to a space or run the model yourself.

## Model description 

This is a SDXL LoRA specifically designed for generating material textures, as well as images of 3D objects with the textures already applied to them.

It's recommended to use controlnet for maximum consistency between images.
The model is already in a standard safetensors format, and can be readily used in A1111, ComfyUI, or any other model inference API of your choosing.
This model is part of the "Material synthesis with diffusion models" project by Artemiy Zhukov.

## Trigger words
To represent different texture types, the model uses a two-token system for the type of texture.

`heighmap` - height texture

`colormap` - albedo texture

`roughmap` - roughness texture

`normalmap` - normal texture

`specmap` - specular texture

`ambmap` - ambient occlusion texture

`metalmap` - metallic texture

Here are some examples of the 3D model in action (although you may want to use the base if you just want top-down textures)
<Gallery />