CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
Authors: Hui Zhang
Dexiang Hong
Maoke Yang
Yutao Cheng
Zhao Zhang
Weidong Chen
Jie Shao
Xinglong Wu
Zuxuan Wu
Yu-Gang Jiang
Venue: ICLR 2026 Poster (2026)
Keywords: Text-to-Image generation
Controllable Image Generation
Diffusion Models
Primary area: generative models

Abstract: Graphic design plays a vital role in visual communication across advertising, marketing, and multimedia entertainment. Prior work has explored automated graphic design generation using diffusion models, aiming to streamline creative workflows and democratize design capabilities. However, complex graphic design scenarios require accurately adhering to design intent specified by multiple heterogeneous user-provided elements (\eg images, layouts, and texts), which pose multi-condition control challenges for existing methods. Specifically, previous single-condition control models demonstrate effectiveness only within their specialized domains but fail to generalize to other conditions, while existing multi-condition methods often lack fine-grained control over each sub-condition and compromise overall compositional harmony. To address these limitations, we introduce CreatiDesign, a systematic solution for automated graphic design covering both model architecture and dataset construction. First, we design a unified multi-condition driven architecture that enables flexible and precise integration of heterogeneous design elements with minimal architectural modifications to the base diffusion model. Furthermore, to ensure that each condition precisely controls its designated image region and to avoid interference between conditions, we propose a multimodal attention mask mechanism. Additionally, we develop a fully automated pipeline for constructing graphic design datasets, and introduce a new dataset with 400K samples featuring multi-condition annotations, along with a comprehensive benchmark. Experimental results show that CreatiDesign outperforms existing models by a clear margin in faithfully adhering to user intent.

Published as a conference paper at ICLR 2026
CREATIDESIGN: A UNIFIED MULTI-CONDITIONAL DIFFUSION TRANSFORMER FOR CREATIVE GRAPHIC DESIGN
Hui Zhang 12.3. Dexiang Hong Maoke Yang"
Yutao Cheng
Zhao Zhang*
Weidong Chen Jie Shao Xinglong Wu Zuxuan Wu 1,2.t Yu-Gang Jiang 22
l Institute Trustworthy Embodied AI, Fudan University
2 Shanghai Key Laboratory of Multimodal Embodied AI
BBytedance Intelligent Creation
'School of Information Science and Technology, University of Science and Technology of China
DARK AMAZON
APOCALYPSE NOW
TRAVEL ADVENTURE
PIRATES GARIBBEAN
SPIDER
AIMA SEST
Hot Feg
PRANK! FAKE GHOS HALLOWEEN
PICK YOUR favourite
FRESH SMOOTHIES
WELCOME
HAPPY ATHERR'ON DAY
EXPLORE AUSTRALIA
SKINCARE Product
Hello
puruuar
OFF
Figure I: CreatiDesign generates high-quality graphic designs based on user-provided image assets and semantic layouts, covering wide range of categories such movie posters, brand promotions, product advertisements, and social media content.
ABSTRACT
Graphic design plays vital role in visual communication across advertising, marketing, and multimedia entertainment. Prior work has explored automated graphic design generation using diffusion models, aiming to streamline creative workflows and democratize design capabilities. However, complex graphic de- sign scenarios require accurately adhering design intent specified by multiple heterogeneous user-provided elements (e.g. images, layouts, and texts), which pose multi-condition control challenges for existing methods. Specifically, previ- ous single-condition control models demonstrate effectiveness only within their specialized domains but fail generalize other conditions, while existing multi- condition methods often lack fine-grained control over each sub-condition and compromise overall compositional harmony. To address these limitations, we introduce CreatiDesign, a systematic solution for automated graphic design cov- ering both model architecture and dataset construction. First, we design unified multi-condition driven architecture that enables flexible and precise integration
Equal contribution. Corresponding author.

---

Published as a conference paper at ICLR 2026
of heterogeneous design elements with minimal architectural modifications the base diffusion model. Furthermore, to ensure that each condition precisely controls its designated image region and to avoid interference between conditions, we propose a multimodal attention mask mechanism. Additionally, we develop a fully automated pipeline for constructing graphic design datasets, and introduce a new dataset with 400K samples featuring multi-condition annotations, along with comprehensive benchmark. Experimental results show that CreatiDesign outperforms existing models by a clear margin in faithfully adhering to user intent.
INTRODUCTION
Graphic design (Jobling & Crowley, 1996) is a fundamental vehicle for visual communication, affective perception, and brand identity across advertising, marketing, and multimedia entertainment.
Recently, diffusion models (Ho et al., 2020; Dhariwal & Nichol, 2021) have achieved remark- able advances, especially in text-to-image generation (stability.ai, 2024; Labs, 2024), which can produce visually compelling and semantically rich images. Leveraging these models to automate streamlining creative workflows and democratizing design capabilities has attracted increasing attention (Gao et al., 2025a; Chen et al., 2025; Peng et al., 2025).
graphic
However, as illustrated in Figure 2, graphic design generation poses unique challenges because it requires the precise control and harmonious arrangement of multiple heterogeneous elements, typically comprising three categories: 1) Primary visual elements, which act as visual focal points and convey the central theme (e.g. product subjects, provided in image format); II) Secondary visual elements, which offer contextual support and enrich the composition (e.g. decorative objects, specified by semantic description and position in layout); and IIII Textual elements, which directly convey essential information (e.g. slogans or product names, also provided as layout). This multi- element nature introduces multi-condition control requirements for diffusion models, as it demands both semantic and spatial fidelity to users' design intent.
While several works have explored unleashing the potential of diffusion models for automatic graphic design generation, three major challenges remain unresolved: I) How to integrate multiple heterogeneous conditions in a unified manner. Previous expert models are typically tailored for only a single type of condition, and often fail to follow other conditions. As illustrated in Figure 2, image- driven models Wang al. (2024b); Wu al. (2025); Labs (2025) focus exclusively on aligning with primary visual elements, whereas layout-driven models Peng et al. (2025); Ma et al. (2025b); Zhang et al. (2024) are limited to following the semantic descriptions and spatial arrangements of secondary visual or textual elements. Such biased capability often leads to reduced fidelity to user intent, as highlighted by the red and purple masks. II) How to preserve fine-grained controllability for each condition while achieving harmonious compositions. Existing multi-condition approaches (Xiao et al., 2024; Gao et al., 2025a; goo, 2025; ope, 2025) lack accurate control over each sub-condition and fail to effectively coordinate all elements, resulting in outputs that do not faithfully reflect user design intent. III) How to construct large-scale, multi-element graphic design datasets in an automated manner. Ready-to-use graphic design datasets with fine-grained, multi-condition annotations remain scarce, which naturally prevents models from learning design capabilities.
To this end, we propose CreatiDesign, systematic solution for intelligent graphic design generation that addresses the aforementioned challenges through the following components: 1) Unified multi- condition driven architecture. CreatiDesign preserves the strong generative capabilities of text-to- image diffusion models while unlocking their potential for graphic design with minimal architectural modifications. Specifically, the native image encoder embeds the multi-subject image condition into the latent space, while the semantic layout is processed by extracting textual features with the text encoder and fusing them with positional information. After encoding all modalities into a unified feature space, native multimodal attention (MM-Attentinn interaction across modalities. This allows for unified and flexible multi-condition control over the generated content. II) Efficient Multi-Condiine condition precisely controls its designated image regions and to avoid mutual interference that could compromise the unique characteristics of each condition, we introduce carefully designed attention masks to regulate the interaction scope of each modality within the multimodal attention mechanism. This design enables each condition to independently and efficiently control its target region, while
is applied to enable deep integration and
Coordination. To ensure that each heterogeneous
2

---

Published as a conference paper at ICLR 2026
maintaining high overall compositional harmony. IIII Automated Dataset Construction Pipeline. We develop a fully automated pipeline for constructing graphic design datasets. This pipeline consists of design theme generation and rendering, conditional image generation, and multi-elemee annotation and filtering. As a result, we construct a training dataset containing 400K design samples with multi-condition annotations, along with comprehensive benchmark for rigorous evaluation.
Task: Graphic Design Based on Multiple Conditions
SOTA image-driven Models
Suli-Sunject Image Conatioo
Coconut Flakes
Prandd Flelbsd
User Provided Canves
Phimary
Ted: Cooamu Faakas"
Visuel Eleeeete
(Images Positons)
botle Medd
Spiit
MS-Dilfunn AiS-Diffusion
UNO
FLUX-Fil
wooden
Semanlic Layouf Conditio
SOTA Layoul-driven Models
Secondary Vieual Bament
Flaments
Texnsl
Coconut
EDW C CARIINE
COCENUT FLAES
(0,00 0.37. (.21.0.55)
(S,S, D (110 (.366
Flakes
PETHUKTUIE
Flakao"
poster featuring a of
Provised
Mit
Some Stanehane
Thet: "Sprrsdi
coconut liekes, coconut, mik, pinospple, and bluchomiss.
0.35,0355 U.26, (6,00.77 (.77)
(0.10.0
"Coconul Flakes" and "Sorinde Some Sunshinel"
Text
(Semanlic Description + Poslion)
BizGen
HiCo
CreatiLayoul
Target
Ours
SOTA MultiConndtion Driven Models
Coconut Flakes
Coconut Flakes
Coconut Flakes
COCONUT FLAKES
Liiing
Emu2
PosterMaker
OmniGen
Gemini.0 ..
GPT-40
Figure 2: An overview of our motivation. Graphic design is multi-condition driven generation task that requires the precise and harmonious arrangement of heterogeneous elements, including primary visual elements (provided as images with positions), as well as secondary visual and textual elements (both specified by semantic descriptions and positions). Previous methods either support only single type of condition (e.g. image-driven layout-driven models) or lack accurate control over each sub-cos lub-condition(e.g multi-condition driven models), resulting in failure to strictly adhere to user design intent, as highlighted by the red and purple masks.
2 RELATED WORK
2.1 TEXT-TO-IMAGE GENERATION
Text-to-image (T2I) generation (Rombach et al., 2022; Podell et al., 2024; Saharia et al., 2022: Chen al., 2024c; Li et al., 2024) aims to generate visual content from textual descriptions, and has achieved remarkable progress in both visual quality and semantic alignment. Recent advances, such as SD3 series (Esser al., 2024; stability.ai, 2024), Cog View4 (THU, 2025), FLUX. 1 (Labs, 2024), HiDream (HiD, 2025), and Seedream series (Gong et al., 2025; Gao et al., 2025b), have pushed the frontier further by leveraging Multimodal Diffusion Transformer architectures (MM-DiT). Despite these advances, existing T2I models still struggle with fine- mneingiieed controllability, particularly in scenarios where users wish to specify precise subject identities or detailed compositional layouts.
2.2 CONTROLLABLE IMAGE GENERATION
To achieve precise control, a variety conditional image generation paradigms have been proposed, including subject-driven (Ruiz et al., 2023; Cai et al., 2024; Tan et al., 2024; Shin et al., 2024; Zhu et al., 2025; Labs, 2025; Wu et al., 2025; Wang et al., 2024b), layout- driven (Li et al., 2023;
Wang et al., 2024c; Zhou et al., 2024; Feng et al., 2024; Zhang et al., 2024; Peng et al., 2025;
3

---

Published as a conference paper at ICLR 2026
Layout Condition
Prompt
Image
Multi- Suuli-Subject
Crean MM Block
Image Condition
Semarti Desctition
Pooioons
poster
Cocoout Fakkss
bow coconut flakes, coconul, milk, pineapple, and blueberries, Text: "Cosonut Flakes and "Sorinkle Some Sunshinel"
Sseae Suratind
lod. "Gp vekk
MB
MM--Aleeton
Encoder
Foutso
FFN
FFN
Layout Encoder
Text Encoder
Image Encader
Image Encoder
d000 Prompi
0000 Sudject Touets
Layyou Tolanne
Image Iobana
CreatiDesign
C0O0
Multimdall
Figure 3: An overview of the architecture. CreatiDesign integrates subjects and semantic layout conditions through native multimodal attention. Multimodal attention mask ensures that each condi- tion precisely controls its designated image regions while preventing leakage between conditions.
Zhou al., 2025; Ma al., 2025b), and conditions-suuch as preserving the visual characteristics of the provided subjects or adhering to layout specifications but often fail to follow other conditions. In response, multi-condition driven frameworks (Sun et al., 2024; Xiao et al., 2024; goo, 2025; ope, 2025; Wang et al., 2025a; Qin et al., 2023; Hu al., 2023; Zhao al., 2023; Ran al., 2024; Yang et al., 2024) have been introduced to jointly handle heterogeneous user-provided conditions. However, these unified approaches often lack accurate control over each sub-condition.
These expert models excel at controlling specific
2.3 AUTOMATIC GRAPHIC DESIGN
Several works (Gao et al., 2025a; Wang et al., 2025b; Chen et al., 2025; Pu et al., 2025; Ma et al., 2025a; Wang et al., 2024a; Liu et al., 2024; Chen al., 2024b; Tuo al., 2024) have attempted to automate graphic design generation, aiming to streamline creative workflows and democratize design capabilities. However, automatic graphic design introduces distinct challenges beyond general text-to-image or controllable image generation, requiring models to precisely preserve user-specified subjects, align secondary visual and textual elements with detailed semantic and spatial constraints, and maintain overall visual coherence. Despite recent progress, most existing methods struggle to meet all these demands simultaneously. This underscores the need for unified, highly controllable, and harmonious solution, which is exactly the goal of this paper.
METHOD
3.1
PROBLEM FORMULATION
This paper focuses on the task of graphic design generation, where each design typically comprises multiple heterogeneous clements provided by the user, such as primary visual elements, secondary visual elements, and textual elements, as illustrated in Figure 2. The key challenge is to accurately and harmoniously integrate these user-specified dlements-eate representing distinct aspects of user intent-into the generated image. Formally, the task be defined as: I, f(P, Ia. L), where I, denotes the generated image, P is the global prompt describing the overall image. I, represents the multi-subject image condition (i.e., a set of primary visual elements). L denotes the semantic layout condition, which consists of elements, partitioned into two categories; secondary visual elements and textual elements. Each layout element is defined by a pair (d,, b,). where d, the semantic description and b; is the spatial position (bounding box), formally expressed as:
L (4 (d;, b.)) y l {secondary visual element, textual element). In the following sections, we will introduce the key parts of CreatiDesign in detail.
(1)
4

---

Published as a conference paper at ICLR 2026
3.2 UNIFIED MULTI-CONDITION DRIVEN ARCHITECTURE
In MM-DiT-based text-to-image models (e.g. F (Labs, 2024)), text encoder (e.g. T5 (Raffel et al., 2020)) is employed to tokenize and encode the input prompt into a sequence of text tokens, denoted as hp. Concurrently, an image encoder (e.g. VAE (Kingma, 2013)) is utilized encode the ground-truth image into a latent representation z, which is subsequently partitioned into patches to obtain image tokens, denoted as hy. These text and image tokens are then fed into MM-Attention, which facilitates rich interactions between the textual and visual modalities, thereby enabling precise control over the image content. Our approach aims to retain the strong capabilities of T21 models while unlocking their potential for graphic design with minimal architectural modifications, as illustrated in Figure 3.
Tokenize Multi-Subjed Image Condition. We first pad the multi-subject image condition with background color (e.g. gray) and encode it using the native VAE. The encoded latent representation is then partitioned into patches to obtain the subject tokens hg-
Tokenize Semantic Layout Condition. For each element 1, = (d,, in the semantic layout condition, we utilize the native T5 text encoder to extract the semantic feature he from de. For the bounding box b;. we apply Fourier positional encoding (Mildenhall et al., 2021; Li et al., 2023) to obtain the spatial feature h.. The final layout token hς obtained by concatenating hς and hy along the feature dimension, followed by layout encoder (i.e. MLPP): A MLP MMLP(CCnccail h))). In this way. layout tokens integrate semantic and spatial information.
Integrate
After encoding the prompt, noise image, subjec image condition, and semantic layout condition into tokens, denoted as hP, h², h², h we concatenate them along the token dimension and feed the token sequence into a stack of MM-DiT Blocks. Each Block consists of linear projection layers (for Q. K. V), multimodal attention (MM-Attention), and feed-forward networks (FFN). Each type of tokens is linearly projected into its corresponding query, key, and value spaces: Q", K* V Linear(h"). where * denotes the modality (layout, prompt, image, or subject). For the layout tokens h and subject tokens It", we further adapt their representations using LoRA modules deployed
the linear layer and adaptive layer normalization (AdaLN), enabling efficient fine-tuning and aligmment. The multimodal attention is then computed as:
n²,, hP",, h²', h²' = Attentionn ([''. Q", Q² Q*), K' K",K*, K. K*), [V] VP, V V*]). (2)
This design enables multiple conditions to control the image content. To avoid positional embedding conflicts, such as between the noise image and image condition, or between the prompt and layout condition, we adopt positional encoding shifts the image and layout condition tokens (Tan et al., 2024) to ensure clear separation in the token space. Overall, this architecture empowers the text-to- image model with multi-condition control capabilities through minimal architectural modifications.
3.3 COLLABORATIVE MULTI-CONDITION CONTROL
Multi-condition driven methods may suffer from degraded controllability over each sub-condition. We attribute this to the fact that the aub-condition is not precisely bound to its corresponding image region and that there is semantic leakage among sub-conditions. To address this, we introduce a multimodal attention mask within our architecture, consisting of layout mask and subject mask.
Layout Attention Mask. Given the uper-feed bounding box b, for each semantic description dy, we can precisely locate the target image region. Inspired by (Chen et al., 2024a), we construct a layout mask such that each layout token hú is only allowed attend to and be attended by the image tokens h3 within its corresponding bounding box. This explicit attention modulation enhances the spatial controllability. Furthermore, we block interactions among layout tokens themselves, between layout tokens and subject tokens, and between layout tokens and prompt tokens, to prevent semantic leakage and to ensure that each layout token retains its unique characteristics.
Subject Attention Mask. Based on the user-provided multi-subject image, we extract the spatial location of each subject to form a subject mask. Each subject token h is only permitted to interact bidirectionally with the image tokens hi within its own mask region, thereby achieving precise subject injection. In addition, to preserve the integrity and distinctive features of the subject token h". we block its interactions with all irrelevant tokens, including layout tokens h', prompt tokens h", and ind image tokens outside the target region of h
5

---

Published as a conference paper at ICLR 2026
With the proposed multimodal attention masks, CreatiDesign allows each condition to precisely and independently control its targeted image region without semantic leakage, thereby producing controllable and harmonious graphic designs that closely match user intent.
promational paster the reads the Magic of Christmas,, The background living room fireplacn, circular wreath...
Semantic Layout Condition
CUPE THE GARgET
SICETLE CHE STESST
Splt
Chair
LLM
HLG
Diffusion Model
Grounding SAM
Seafond
Multi-Subject Image Condition
Design Keywords
Design Theme Gemeration
Text Layer Rendering
Foreground-based Image Generation
Entity Annotation and Filtering
Figure 4: Automated pipeline graphic design dataset construction.
4 GRAPHIC DESIGN DATASETS AND BENCHMARK
4.1 GRAPHIC DESIGN DATASETS
We propose a fully automatic dataset construction pipeline, as shown Figure 4, to address the scarcity of graphic design datasets with fine tne-grained, multi-condition annotations.
Design Theme Generation. Based on a design keywords bank covering common graphic design elements (e.g. furniture, food, clothing etc.), we prompt a large language model (LLM, e.g. GPT-4) to act professional designer and generate design themes that include descriptions of primary visual elements, secondary visual elements, and textual elements.
Text Layer Rendering. Based on the design theme, we follow the Hicrarchical Layout Genera- tion (Cheng et al., 2025) (HLG) paradigm to generate a layout protocol of textual elements and detailed background description. A rendering engine then converts the layout protocol into an RGBA image with accurately positioned foreground text.
Foreground-basee -base Image Generation. To generate visually coherent graphic design image, we draw inspiration from LayerDiffuse (Zhang & Agrawala, 2024) and develop a foreground-condiiione image generation model. Here, the RGBA text layer serves as the foreground, while the background generated based on the aforementioned description. Specifically, we incorporate foreground- LoRA and Background-LoRA modules into FLUX. .edev and employ attention sharing to ensure seamless integration foreground and background elements.
Entity Annotation. We use GroundingSAM2 (ide, 2024) obtain bounding boxes and segmenta- tion masks for all entities in the generated image. A vision-language model (OpenBMB, 2024) (VLM) then employed to generate fine-grained descriptions for each entity. Entities are categorized as either primary or secondary visual elements. All primary visual elements are aggregated to form the multi-subject image condition, while secondary visual elements, together with the textual elements from the layout protocol, constitute the semantic layout condition.
Based on this automatic data construction pipeline, we synthesize graphic design samples at scale, alleviating the data bottleneck for model training. As result, construct new dataset of 400K samples with annotations for various conditions.
4.2 GRAPHIC DESIGN BENCHMARK
To comprchensively evaluate graphic design generation under multiple conditions, we further con- struct rigorous benchmark consisting of 1,000 carefully curated samples. This benchmark is designed to assess whether the generated results faithfully align with user intent- critical require- ment in practical graphic design scenarios.
The evaluation focuses on two key aspects, each with dedicated metrics: D) Multi-Subject Preser- vation. When given multi-subject image conditions (i.e. primary visual elements), it is crucial to

---

Published as a conference paper at ICLR 2026
strictly preserve the unique characteristics of each subject in the generated image. To quantity this, we measure the similarity between each subject and its corresponding region (obtained via bounding box priors or detected by GroundingDINO (Liu al., 2023)) in the generated image using both CLIP (Radford et al., 2021) similarity (CLIP-I) and DINO (Oquab et al., 2023) similarity (DINO-I) scores. We further aggregate the DINO scores of all subjects by multiplication, denoted as M-DINO (Wang et al., 2024b). Unlike averaging, M-DINO is more sensitive to the failure of any single subject, providing stricter assessment of subject preservation. II) Semantic Layout Alignment. For the semantic layout condition, specifying the positions and attributes of secondary visual elements and textual content, we assess alignment spatial and semantic levels. For secondary visual elements, we employ a vision-language model in a Visual Question Answering manner to assess the spatial, color, textual, and shape attributes of each entity the generated image (Zhang et al., 2024; Wu et al., 2024). For textual elements, we use PaddleOCR (pad, 2025) to detect text and calculate sentence accuracy (Sen. Acc), normalized edit distance (NED; i.e. I minus the edit distance) (Gao et al., 2025a), and IoU (spatial score) between detected and ground -ruth texts.
5
EXPERIMENTS
5.1
EXPERIMENTAL SETUP
Dataset. We train our models on the 400K synthetic graphic design samples described in Section 4.1. The validation contains 1,000 samples, covering diverse numbers of primary visual subjects and semantic layout annotations, enabling thorough evaluation of multi-condition controllability.
Evaluation Metrics. As described in Section 4.2, we evaluate model performance from two preservation and semantic layout alignment- assess whether the generated designs accurately fulfill user intent. Additionally, to evaluate overall image quality, we report IR Score (Xu et al., 2023) and PickScore (Kirstain et al., 2023), which jointly capture prompt adherence, visual appeal, and compositional harmony across the entire image.
perspectives-muule
Implementation Details. We fine-tune FLUX.I-dew using LoRA with 256 rank, introducing 491.5M extra parameters (4.1% 1% of FLUX's 12B). We employ the AdamW optimizer with a fixed learning rate of le-4, training for 100,000 steps with batch size of 8 8 H20-96G GPUs over days. We adopt a resolution bucketing strategy during training to support variable image sizes. The image condition set to half the target image size; each layout description is capped 30 tokens, with up to 10 layouts per image.
5.2
COMPARISON WITH PRIOR WORKS
Baseline Methods. We compare Design with three types of previous SOTA models: multi- subject image-driven models (Wu al., 2025; Wang al., 2024b; Labs, 2025), semantic layout-driven models (Zhang et al., 2024; Ma et al., 2025b; Peng et al., 2025; Tuo et al., 2024), and multi-condition driven models (Sun al., 2024; goo, 2025; Xiao et al., 2024; Gao et al., 2025a).
Quantitative Comparison. As shown in Table I, specialist models excel primarily their targeted control ienditions-imaae-ddrie models can preserve subjects, while layout-driven models can follow semantic layout control-bur but perform poorly when handling other conditions. Conversely, previous multi-condition models often lack fine-grained control over each sub-condition, resulting in lower subject preservation and semantic alignment. In contrast, Creati achieves precise, balanced control across all conditions, as reflected in its top-tier performance across every sub- condition and clear lead in average scores. Remarkably, this advanced graphic design capability is achieved with minor architectural modifications to the base model FLUX.1-dew and only 4.1 % extra parameters were introduced, demonstrating both effectiveness and efficiency.
Qualitative Comparison. To further illustrate the advantages of CreatiDesign, Figure 7 presents qualitative comparisons on challenging cases with multiple subjects and complex layouts. Existing SOTA methods- inniuudii-ininiinng multi-condition driven models and single-condition experts experts-consistently fall short in faithfully fulfilling user intent. Previous multi-condition models exhibit limited precision in controlling aub-oondiiions resulting in misplaced or inconsistent subjects (highlighted by purple masks), as well as content or spatial misalignment in the layout (highlighted by red masks). Layout- driven models like BizGen (Peng et al., 2025) can follow the layout but struggle with subject
7

---

Published as a conference paper at ICLR 2026
Table 1:
Quantitative Results. We compare CreatiDesign with three types of previ- ous SOTA models: multi-subject image-driven models semantic layout-driven models and multi-condition driven models. The best results are shown in bold, and the top-3 results are highlighted. Our proposed method significantly enhances the graphic design capabilities of the baseline. achieves top-tier performance across all metrics, and shows clear lead in average score.
Multi-Subject Preservation
Semantic Layout Aligument
Image Quality
Avg.
Primary Visual Elements
Secondary Visual Elements
Textual Elements
CLIP-I DINO-I M-DINO
Spatial
Color
Textual
Shape
Spatial Sen, Ace
NED
IR
PickScore
UNO
77.97
47.88
20.79
53,10
43,44
42.62
41.30
11.47
40.87
74.51
61,06
21.67
44.72
MS- DiS-Diffusion
84.75
74.13
44.34
49.54
33.37
34,89
34.79
1.01
0.00
10:21
46.64
21.03
36.23
FLUX.I-FE I-Fill
90.79
87.32
69.05
67.55
57.48
56.26
55.75
12.48
12.07
56.69
40.74
20.71
52.24
CreatiLayout
78.41
55,54
25.31
77.42
63.07
62.67
60.21
18.59
12.27
74.21
59.92
21.04
50.72
HiCo
72.45
34.47
11.59
79.69
61.46 1488
61.17
60.17
1.01
0.00
14.98
-36.16
19.58
31.70
BizGen
79.86
53.08
22.93
79.84
62.96
62.86
61.01
50.44
75.89
94.61
37.43
21.48
58.53
Any AnyTex12
74.68
34,86
12.22
36.63
27.58
27.16
26.53
53.95
9.56
48.26
-25.95
20.24
28.81
Emu2
73,96
45.17
19.92
60.81
45.37
46,20
44.06
0.20
0.00
13.81
-1.84
20.18
30.65
PosterMaker
90.45
87.72
69.56
56.36
45.37
44,25
41. 61
28.42
0.70
28, 62
31.62
20.31
45,42
OmniGen
82,15
58.83
30.86
53.92
44.35
44,46
41.40
8.24
6.72
49.12
22.94
20.62
38.63
Gemini2.0
81,46
57.23
29.68
59.41
$2.29
52.49
50.36
16.60
71.38
88.71
28.52
21.23
50.78
FLUX.1-de 75.93
44,59
17.76
60.02
47.1
46.
44.76
13.25
57.95
81.52
59,45
21.48
47,50
CreatiDesign
89.39
86.48
65.75
78.94
66.02
66.94
65.82
56.90
78.30
94.68
60.02
21.49
69.28
vs. Baseline
+13.46
+-11.89
+47.99
+18.92
+18.92
+20.75
+21.06
+43.65
+20.35
+13.16
+1.17
+0.01
+21.78
consistency. Image-driven models such as FLUX.1-FilI (Labs, 2025) can preserve primary elements but often misplace incorrectly render textual elements. In contrast, CreatiDesign consistently preserves the identity and position of all primary subjects, precisely aligns secondary and textual elements within the layout, and ensures overall compositional harmony.
Intial
Insort ULITION
Moaily
Image Condiion
Postion Acournry
Subject Proversttion
dlyenee ULTRON
Aneweeer LE TERH
Aewwerr WAY
Layout Condition
Poslion Accuraey
Atrbblte Ascunacy
lest Accursay
Guand Quality
Prompe Following
Vause Quallty
1812 4:21
6:81
18.58
7.24
8:05
8.75
FL
3:88
8.59
6:82
1889
311
8:11
8.24
Butaan
1802
4:8
9:21
8.08
8:18
8.67
7.65
Multi Condition
Creon
Omni0on
721
6.77
7,28
6,87
387
8,01
7A2
The perdic
AVENTERS
Aussiise
FostaMMker
9:66
9.40
8.54
6,56219
7.12
8.12
in de ramm
INPART HAR
conce concersed eigh syyoos cema hext aelo lellen
7.84
8.11
7.46
7.87
9.11
8.08
7.88
Design
9.56
9047
K.45
9.14
Globall Phonpt
Figure 5: User Study. CreatiDesign demon- strates top-tier performance in preserving multi- subject characteristics, strictly following seman- tic layout conditions, and achieving high overall image quality.
Figure 6: Comparison on Loop Editing. Cre- atiDesign precisely follows editing commands and maintains high consistency in non-edited ar- eas. In contrast, Gemini2.0 frequently introduces unwanted attribute changes to subjects or text.
User Study. To comprehensively assess the practical effectiveness of CreatiDesign, we conducted a user study involving feedback from both professional designers and general users. Specifically, we solicited 50 evaluation reports on 30 diverse graphic design samples, comparing our method with several state-of-the-art baselines. As illustrated in Figure 5, participants rated the generated designs on a scale of 1 to 10 across multiple criteria, including adherence to multi-subject image conditions (position accuracy and subject preservation), alignment with semantic layout conditions (position accuracy, attribute accuracy and text accuracy). and overall perceptual quality (prompt following and visual quality). The statistical results demonstrate that CreatiDesign outperforms
8

---

Published as a conference paper at ICLR 2026
Mutt-Condition Methods
Layout Driven
Image Driven
Mutti-Conditon
Ours
CPT40
Gemini2.0
OmniGen
PosterMaker
BizGen
FLUX. 1-Fil
Largu loruecille
CURRY NIGHT
curry night
CURRY NIGHT
Dury Night Jan Ue!
Curry Night: Join Us!
RADIATE LIFE
Jess RO
RADIATE LIFE
RAD ATEIL
RAGIA LIFE
JASS Hantol Sog. Scroc
ADON YOU
REVIVE SENSES
Revive ou
SOUL
DUT RACRRN Sout
AwaSan
EOENE
POUR STUR FAVE
Figure 7: Quantitative Results. Compared with previous multi-condition or single-condition models, CreatiDesign demonstrates stricter adherence to user intent, including high subject preservation and precise layout alignment. Purple masks: inconsistent or mispositioned subjects. Red mask: entities with incorrect semanties locations. Gray mask: disharmonious background or foreground regions.
previous methods in ane-grained controllability and overall visual appeal, delivering superior user satisfaction in real-world graphic design scenarios.
5.3 FREE LUNCH: EXPANDING TO EDITING TASKS
As illustrated in Figure 6, CreatiDesign naturally extends beyond graphic design to a wide range of editing tasks without extra retraining. We demonstrate this capability via editing a series of movie posters. Initially, the user provides a global prompt, a multi-subject image condition (e.g. Hulk and Iron Man), and semantic layout specifying elements and their spatial positions (e.g. Captain America and the "Avengers" title). CreatiDesign generates a high-quality poster P1 that precisely adheres to these controls. Subsequently, sequence of editing operations is performed: first, by treating the previously generated poster P1 as the new image condition and introducing a new text element " "AGE OF ULTRON" with its desired position, CreatiDesign seamlessly inserts this subtitle to produce P2; Next, by combining the Spider-Man image and its insertion mask with P2 as the image condition, CreatiDesign generates Ps. achieving seamless integration of the new subject while preserving character fidelity and overall visual harmony; finally, by combining P3 with the mask of the edited region as the image condition, the subtitle is modified to "INFINITY WAR" (P4). Throughout these editing processes, CreatiDesign consistently maintains subject identity, achieves accuracy layout control and overall visual harmony. In contrast, strong baselines such as Gemini2.0 frequently fail to preserve non-edited regions during sequential edits, often resulting unwanted attribute changes to subjects or text, highlighting a lack of strict adherence to user intent.
5.4 ABLATION STUDY
Table 2 and Figure 8 evaluate the contributions of the three key components- Encoder (LE), Layout Attention Mask (LAM), and Subject Attention Mask (SAM) to the performance of CreativeDesign from quantitative and qualitative perspectives, respectively. The LE fuses the semantic features of the textual description with Fourier-encoded positional features and further aligns them into layout tokens; removing IEE leads to clear drop in the accuracy of generated text. The

---

Published as a conference paper at ICLR 2026
layout attention mask enables fine-grate fine-grained spatial control by explicitly restricting each layout element to modulate only its designated image region and preventing semantic leakage across layout elements; removing LAM leads to imprecise placement of elements and increased confusion across different layout regions, as demonstrated by the decrease in spatial alignment and attribute accuracy. Similarly, the subject attention mask ensures that each subject token only interacts with its corresponding image region and blocks interference from global prompts and layout conditions. Without SAM, we observe the degradation in subject consisteney, such as the incorrect digits on clocks or altered popcorn color. These results validate the effectiveness of each component in achieving faithful and controllable graphic design generation.
Cond Bon
Great
wib LAM
AIO SAM
Table 2: Ablation study: quantitative analy- sis of key components in CregtiDesign.
Subject Preseriation
Scmantic Layost Aligntintt
Sherdore
Visual Elements
Visnel Elements
Textal Elements
DINO
M DINO
Spotial Autiibte
Spatial Scn. Age
CreatiDesign 86.48
65.75
78.94
66.26
$6.90
78.30
wio LAM
85.79
64.28
66.94
56.19
20.15
68.41
Web SAM
X5.70
64.14
75.99
64.90
56.92
76,84
Figure 8: Qualitative Results of Ablation Study.
6 CONCLUSION
In this paper, we presented CreatiDesign, systematic solution that empowers diffusion transformers for intelligent and highly controllable graphic design generation. We designed a unified multi- condition driven architecture that seamlessly integrates heterogeneous design elements. Furthermore, we proposed multimodal attention mask mechanism to ensure that each condition precisely controls its designated image region and to prevent interference between conditions. In addition, we introduced fully automated pipeline for constructing large-scale, richly annotated graphic design datasets. Extensive experiments demonstrated that CreatiDesign outperforms previous methods in subject preservation, semantic layout alignment, and overall visual quality.
Limitation and Future Work. CreatiDesign faces challenges in accurately preserving facial details and generating dense text, as our current dataset is not tailored for these scenarios. Improving performance in such cases, either through dataset enhancement model-level advances, represents an important direction for future research.
7 ACKNOWLEDGMENTS
This work was supported by National Natural Science Foundation of China (No. 62521004).
REFERENCES
Grounded-sam-2.
http:///wws/.//.o....oo/////ee// SAM-2, 2024.
Hidream-il,
http::///gghaaa...oo/////aaaaaaa 2025.
, httppp////attbb..ocooo/////////p 2025.
-elini-2.0-flash. https://aistudio
htt.ap/t....oo.a.......oo/////ee 2model 2025.
40 image
generation.
https://openai..com /
introducing-4o--
2025.
Paddleocr-v4.
http://www..eeeeeeeeeeeeeeeaeeaa 2025. 2025.
Shengqu Cai, Eric Chan, Yunzhi Zhang, Leonidas Guibas, Jiajun Wu, and Gordon Wetzstein. Diffu- sion self-distillation for zero-shot customized image generation. arXiv preprint arX1v22411.18676
2024.
10

---

Published as a conference paper at ICLR 2026
Anthony Chen, Jianjin Xu, Wenzhao Zheng, Gaole Dai, Yida Wang, Renrui Zhang, Haofan Wang, and Shanghang Zhang. Training-fii free regional prompting for diffusion transformers. arXiv preprint arXiv:2411.02395 2024a.
Haoyu Chen, Xiaojie Xu, Wenbo Li, Jingjing Ren, Tian Ye, Songhua Liu, Ying-Cong Chen, Lei Zhu, and Xinchao Wang. Posta: A go-to framework for customized artistic poster generation. In CVPR, 2025.
Jingye Chen, Yupan Huang, Tengchao Lv. Lei Cui, Qifeng Chen, and Furu Wei. Textdiffuser-2: Unleashing the power of language models for text rendering. ECCV, 2024b.
Junsong Chen, YU Jincheng, GE Chongjian, Lewei Yao, Enze Xie, Zhongdao Wang, James Kwok, Ping Luo, Huchuan Lu, and Zhenguo Li. Pixart-o: Fast training of diffusion transformer for photorealistic text-to-image synthesis. In ICLR, 2024c.
Yutao Cheng, Zhao Zhang, Maoke Yang, Hui Nie, Chunyuan Li, Xinglong Wu, and Jie Shao. Graphic design with large multimodal model. In AAAI, 2025.
Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans image synthesis. In NeurIPS, 2021.
Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et Scaling rectified flow transformers for high-resolution image synthesis. arXiv preprint arXiv:2403. 03206, 2024.
Yutong Feng, Biao Gong, Di Chen, Yujum Shen, Yu Liu, and Jingren Zhou. Ranni: Taming text-to- image diffusion for accurate instruction following. In CVPR, 2024.
Yifan Gao, Zihang Lin, Chuanbin Liu, Min Zhou, Tiezheng Ge, Bo Zheng, and Hongtao Xie. Postermaker: Towards high-quality product poster generation with accurate text rendering. In CVPR, 2025a.
Yu Gao, Lixue Gong, Qiushan Guo, Xiaoxia Hou, Zhichao Lai, Fanshi Li, Liang Li, Xiaochen Lian, Chao Liao, Liyang Liu, al. Seedream 3.0 technical report. arXiv preprint arXiv:2504.1 1146, 2025b.
Lixue Gong, Xiaoxia Hou, Fanshi Li, Liang Li, Xiaochen Lian, Fei Liu, Liyang Liu, Wei Liu, Wei Lu, Yichun Shi, et al. Seedream 2.0: native baiglsh-english bilingual image generation foundation model. arXiv preprint arXiv:2503.07703, 2025.
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. NeurIPS, 2020.
Minghui Hu, Jianbin Zheng, Daqing Liu, Chuanxia Zheng, Chaoyue Wang, Dacheng Tao, and Tat-Jen Cham. Cocktail: Mixing multi-modality control for text-conditional image generation. In NeurIPS, 2023.
Paul Jobling and David Crowley. Graphic design: reproduction and representation since 1800. 1996.
Diederik P Kingma. Auto-encoding variational bayes. arXiv preprint arXiv: 2013.
Yuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana, Joe Penna, and Omer Levy. Pick-a-pic: An open dataset of user preferences for text-to-image generation. arXiv preprint arXiv:2305.01566, 2023.
Black Forest
Labs.
Plux.1-dew.
https::/blackforestiaaas
announcing mnrouncing-black wowckt-foret-laaaa 2024.
Black Forest Labs. 1-fll--ill-dev. httppp///hhgpaaaae..ooooaao-oo-/
FLUX. 1- 2025.
Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee. Gligen: Open-set grounded text-to-image generation. In CVPR, 2023.
11

---

Published as a conference paper at ICLR 2026
Zhimin Li, Jianwei Zhang, Qin Lin, Jiangfeng Xiong, Yanxin Long, Xinchi Deng, Yingfang Zhang, Xingchao Liu, Minbin Huang, Zedong Xiao, et al. Hunyuan-dit: A powerful multi-resolution diffusion transformer with fine-grate ine-grained chinese understanding. arXiv e-prints, 2024.
Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang. Hang Su, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. arXiv preprint arXiv:2303.055 0.499, 2023.
Zeyu Liu, Weicong Liang, Zhanhao Liang, Chong Luo, Ji Li, Gao Huang, and Yuhui Yuan. Glyph- byt5: A customized text encoder for accurate visual text rendering. In ECCV, 2024.
Jian Ma, Yonglin Deng, Chen Chen, Nanyang Du, Haonan Lu, and Zhenyu Yang. Glyphdraw2: Automatic generation of complex glyph posters with diffusion models and large language models. In AAAI, 2025a.
Yuhang Ma, Shanyuan Liu, Ao Ma. Xiaoyu Wu, Dawei Leng, and Yuhui Yin. Hico: Hierarchical controllable diffusion model for layout-to-image generation. In NeurIPS, 2025b.
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes neural radiance fields for view synthesis. Communications of the ACM, 2021.
OpenBMB. 2024.
Minicpm-v-2.6. https:/ httpps//wwuggiggee....o/opoo/oop
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Mare Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:230.007193, 2023.
Yuyang Peng, Shishi Xiao, Keming Wu, Qisheng Liao, Bohan Chen, Kevin Lin, Danqing Huang, Li, and Yuhui Yuan. Bizgen: Advancing article-level visual text rendering for infographics generation. In CVPR, 2025.
Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach. Sdxl: Improving latent diffusion models for high-resolution image synthesis. In ICLR, 2024.
Yifan Pu, Yiming Zhao, Zhicong Tang, Ruihong Yin, Haoxing Ye, Yuhui Yuan, Dong Chen, Jianmin Bao, Sirui Zhang, Yanbin Wang, al. Art: Anonymous region transformer for variable multi-layer transparent image generation. In CVPR, 2025.
Can Qin, Shu Zhang, Ning Yu, Yihao Feng, Xinyi Yang. Yingbo Zhou, Huan Wang, Juan Carlos Niebles, Caiming Xiong, Silvio Savarese, et al. Unicontrol: A unified diffusion model for controllable visual generation in the wild. arXiv preprint arXiv:2305.11147, 2023.
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In ICLM, 2021.
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine I Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with unified text-to-text transformer. JMLR, 2020.
Lingmin Ran, Xiaodong Cun, Jia-Wei Liu, Rui Zhao, Song Zijie, Xintao Wang, Jussi Keppo, and Mike Zheng Shou. X-adapter: Adding universal compatibility of plugins for upgraded diffusion model. In CVPR, pp. 8775-8784, 2024.
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High- resolution image synthesis with latent diffusion models. In CVPR, 2022.
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In CVPR, 2023.
12

---

Published as a conference paper at ICLR 2026
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Photorealistic text-to-image diffusion models with deep language understanding. In NeurIPS, 2022.
Chaehun Shin, Jooyoung Choi, Heeseung Kim, and Sungroh Yoon. Large-scale text-to-image model with inpainting is a zero-shot subject-driven image generator. arXiv preprint arXiv:2411.15466 2024.
stability.ai.
diffusion introddciong-sabblll--..ffo-----
Stable
3.5.
https://stabliity.at
Quan Sun, Yufeng Cui, Xiaosong Zhang, Fan Zhang, Qiying Yu, Yueze Wang, Yongming Rao, Jingjing Liu, Tiejun Huang, and Xinlong Wang. Generative multimodal models are in-context learners. In CVPR, 2024.
Zhenxiong Tan, Songhua Liu, Xingyi Yang, Qiaochu Xue, and Xinchao Wang. Ominicontrol: Minimal and universal control for diffusion transformer. arXiv preprint arXiv:2411. 2024.
Yuxiang Tuo, Yifeng Geng, and Liefeng Bo. Anytext2: Visual text generation and editing with customizable attributes. arXiv preprint arXiv:2411.15245 2024.
Haoxuan Wang, Jinlong Peng, Qingdong He, Hao Yang. Ying Jin, Jiafu Wu, Xiaobin Hu, Yanjie Pan, Zhenye Gan, Mingmin Chi, et al. Unicombine: Unified multi-conditional combination with diffusion transformer. arXiv preprint arXiv:2503.0927) 2025a.
Shaodong Wang, Yunyang Ge, Liuhan Chen, Haiyang Zhou, Qian Wang, Xinhua Cheng, and Li Yuan. Prompt2poster: Automatically artistic chinese poster creation from prompt only. In ACMMM, 2024a.
Xierui Wang, Siming Fu, Qihan Huang, Wanggui He, and Hao Jiang. Ms-diffusion: Multi-subject zero-shot image personalization with layout guidance. arXiv preprint vrXiv22406.07000 2024b.
Xudong Wang, Trevor Darrell, Sai Saketh Rambhatla, Rohit Girdhar, and Ishan Misra. Instancedifiu- sion: Instance-level control for image generation. In CVPR, 2024c.
Zhendong Wang. Jianmin Bao, Shuyang Gu, Dong Chen, Wengang Zhou, and Hougiang Li. De- signdiffusion: High-quality text-to-design image generation with diffusion models. In CVPR, 2025b.
Shaojin Wu, Mengqi Huang, Wenxu Wu, Yufeng Cheng, Fei Ding, and Qian He. Less-to-more general- ization: Unlocking more controllability by in-context generation. arXiv preprint arXiv:2504.02116) 2025.
Yinwei Wu, Xiampan Zhou, Bing Ma, Xuefeng Su, Kai Ma, and Xinchao Wang. Ifadapter: Instance feature control for grounded text-to-image generation. arXiv preprint arXiv:2409.08240, 2024.
Shitao Xiao, Yueze Wang, Junjie Zhou, Huaying Yuan, Xingrun Xing, Ruiran Yan, Chaofan Li, Shuting Wang, Tiejun Huang, and Zheng Liu. Omnigen: Unified image generation. arXiv preprint arXiv:2409.1 11.4009.1344 11340, 2024.
Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong. Imagereward: Learning and evaluating human preferences for text-to-image generation. In NeurIPS, 2023.
Quanwei Yang, Jiazhi Guan, Kaisiyuan Wang, Lingyun Yu, Wenqing Chu, Hang Zhou, ZhiQiang Feng, Haocheng Feng, Errui Ding, Jingdong Wang, et al. Showmaker: Creating high-fidelity 2d human video via fine- tin-ggrined diffusion modeling. In NeurIPS, 2024.
Hui Zhang, Dexiang Hong, Yitong Wang, Jie Shao, Xinglong Wu, Zuxuan Wu, and Yu-Gang Jiang. Creatilayout: Siamese multimodal diffusion transformer for creative layout-to-image generation. arXiv preprint arXiv:2412.03859, 2024.
Lvmin Zhang and Maneesh Agrawala. Transparent image layer diffusion using latent transparency. arXiv preprint arXiv:2402.171133 2024.
13

---

Published as a conference paper at ICLR 2026
Shihao Zhao, Dongdong Chen, Yen-Chun Chen, Jianmin Bao, Shaozhe Hao, Lu Yuan, and Kwan- Yee Wong. Uni-controlnet: All-in-ona control to text-to-image diffusion models. NeurIPS, 2023.
Dewei Zhou, You Li, Fan Ma, Xiaoting Zhang, and Yi Yang. Mige: Multi-instance generation controller for text-to-image synthesis. In CVPR, 2024.
Dewei Zhou, Mingwei Li, Zongxin Yang, and Yi Yang. Dreamrenderer: Taming multi-instance attribute control in large-scale text-to-image models. arXiv preprint arXiv:2503. 12885, 2025.
Chenyang Zhu, Kai Li, Yue Ma, Chumming Hc, and Xiu Li. Multibooth: Towards generating all your concepts in image from text. In AAAI, 2025.
14


Reviews:
[{"review_id": "APMCpyPCkm", "reviewer": "Reviewer_U8F2", "summary": "This paper presents CreatiDesign, a unified multi-conditional diffusion transformer for graphic design generation. CreatiDesign can receive inputs from different modalities: keyword, layout, prompt, image, etc. To support the task setting, the authors develop an automated pipeline for constructing a 400K graphic design dataset with multi-condition annotations. Using the dataset, they fine-tune the FLUX.1-dev model, where they modify the original attention strategy to enable multi-condition interaction. Experimental results demonstrate CreatiDesign's superior performance over existing methods in design generation.", "questions": "Please see the weaknesses.", "limitations": "", "rating": 4, "confidence": 4, "soundness": 2, "presentation": 3, "contribution": 2, "strengths": "- The paper tackles a real-world problem with clear applications in graphic design creation. \n- It contributes a large-scale dataset with multi-condition annotations. \n- The curated benchmark can well evaluate the design quality by including multiple metrics covering different aspects.\n- The experimental results show clear improvements of CreatiDesign over baselines.", "weaknesses": "1. The technical contribution of CreatiDesign is limited. The used attention masking, LoRA fine-tuning are straightforward applications of existing techniques.\n2. The model setting requires users to specify exact positions for the elements, making final quality heavily dependent on user design expertise. However, most users may lack such knowledge, thereby limiting its practical applicability. \n3. In the experiments, it seems that the paper only evaluates scenarios where all conditions are simultaneously provided. It would be great if the authors could conduct more experiments using the same model: (1) text-to-design generation (intention-to-design without visual inputs), (2) content-aware text layout generation (placing text on given background images), etc. Evaluating diverse conditioning inputs would demonstrate practical utility across different design workflows and strengthen the effectiveness of CreatiDesign.\n4. The dataset details are not included in the paper, such as the element number, prompt length, diversity, quality, etc.\n5. How does CreatiDesign's inference time compare to other methods?", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}, {"review_id": "1xp7ufXGiu", "reviewer": "Reviewer_yKCt", "summary": "This paper introduces CreatiDesign, a multi-condition diffusion model designed for automated graphic design generation. ​ It integrates flexible multimodal inputs, including global prompts, rendered text, foreground visuals, background elements, and their layout positions. ​ A masked attention mechanism ensures precise control, aligning layout tokens with corresponding visual elements while preventing interference. \nThe authors developed a new dataset with 400K synthetically generated samples and a benchmark of 1,000 annotated samples with ground truth labels. CreatiDesign is shown to outperform existing models in various design metrics.", "questions": "Can this method be extended to support placing given visual elements in appropriate locations in the design? This is similar to traditional layout generation/variation problem. The visual knowledge can give an edge over geometry based methods.", "limitations": "", "rating": 6, "confidence": 3, "soundness": 3, "presentation": 2, "contribution": 2, "strengths": "+ a multimodal controllable generation model developed based on Flex T2I model\n+ block-wise multi-modality attention achieves both controllability and prevents information leakage\n+ a new benchmark dataset with curated high quality 1k set", "weaknesses": "- DiT framework is similar to previous work: Art: Anonymous region transformer for variable multi-layer transparent image generation. In CVPR, 2025.\n- controllability is limited, only with given images and precise layout condition, text layer is not vector font. It would be useful to allow flexible layout position in output.\n- the design images in the benchmark is synthetically constructed, the quality is not guaranteed.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}, {"review_id": "FaNMzBc9jc", "reviewer": "Reviewer_euun", "summary": "This paper presents a multi-conditioned creative graphic design method, where the conditions include semantic descriptions, positions and b-boxes of objects and texts to be placed on the image. The method encodes each condition into tokens and then employ a  multimodal attention mask to prevent the attention procedure from information confusion or leaking. Experimental results demonstrates the designed posters are in high quality.", "questions": "It is tedious for a designer to determine the position of bbox of each text in a poster,  why not directly predict the position of these boxes as did in recent CVPR papers, for instance, Unsupervised domain adaption with pixel-level discriminator for image-aware layout generation in CVPR. Overall, this paper leans towards a graphic-design rendering paper more than a design paper, since the layout should be input by a user.", "limitations": "", "rating": 4, "confidence": 4, "soundness": 2, "presentation": 2, "contribution": 2, "strengths": "1.  The proposed multimodal attention mask is effective in control the behavior of the diffusion model as verified in the ablation study. Both layout attention mask and subject attention mask are important to the quality of the graphical design. \n2. The diffusion model trained with multi-condition dataset can automatically support editing by using the image generated in the previous steps as the condition. While the STOA T-2-I models can support editing to some extent, the controllability of the proposed method should be better by associated bounding box in the graphic design.", "weaknesses": "The overall pipeline is built upon masked attention mechanism. However, masked attention mechanism is widely used in model design. For example, in NLP, casual attention is often used to avoid a token taking information from future tokens. From the perspective of novelty,  I hesitate to give this paper a high score.  In addition, the advantage of the proposed method are limited to the graphical design due to the specific definition of input conditions.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}, {"review_id": "BWJpXfWAP5", "reviewer": "Reviewer_SnTD", "summary": "This paper focuses on the graphic design generation task. A unified multi-condition driven architecture is proposed by integrating different user-provided elements with a multimodal attention mask mechanism. A new graphic design dataset with 400k samples featuring multi-condition annotations, along with a comprehensive benchmark. The experimental results demonstrate the effectiveness of the proposed method in adhering to user intent.", "questions": "1. For entity annotation, take Fig.2 as an example, how to separate different entities as primary or secondary visual elements? Will the generated graphic design be affected by considering different entities as primary or secondary visual elements?\n2. The proposed dataset is constructed via a fully automatic pipeline. Several existing models are used for design theme generation, text layer rendering, and foreground-based image generation. How to ensure the quality of the constructed dataset without involving human annotations or double-checking?", "limitations": "", "rating": 6, "confidence": 4, "soundness": 2, "presentation": 3, "contribution": 3, "strengths": "The proposed method that integrates multiple heterogeneous conditions in a unified manner for graphic design generation is reasonable and effective. The proposed large-scale, multi-element graphic design dataset could also be useful for future research in the community if released.", "weaknesses": "1. The current evaluations mainly compare the proposed method with existing MLLMs for controllable image generation. However, there is a domain gap between natural images and graphic designs. To make fair comparisons, existing multi-condition or single-condition graphic design generation works, e.g., [1-4], should also be discussed and compared.\n2. The user study may not sufficiently demonstrate the practical effectiveness of the proposed method. The motivation of this paper is to ensure the strict adherence between the generated design and the user intent. Thus, the user study should investigate from the above criteria and ask participants to create inputs by themselves, rather than predefining inputs and following similar evaluation metrics used in quantitative comparisons.\n3. Since the proposed dataset is also the contribution of this paper, the ablated versions of the automated pipeline for graphic design dataset construction should also be studied. For example, using different methods or changing the module order for the data construction process.\n\n[1] Hsu, HsiaoYuan, and Yuxin Peng. \"PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generation.\" CVPR 2025.\n\n[2] Horita, Daichi, et al. \"Retrieval-augmented layout transformer for content-aware layout generation.\" CVPR 2024.\n\n[3] Seol, Jaejung, Seojun Kim, and Jaejun Yoo. \"Posterllama: Bridging design ability of language model to content-aware layout generation.\" ECCV 2024.\n\n[4] Yang, Tao, et al. \"Posterllava: Constructing a unified multi-modal layout generator with llm.\" arXiv preprint arXiv:2406.02884.", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "extra_scores": {}}]

Author rebuttal:

Decision: Accept (Poster)