Seedream 4.0: Toward Next-generation Multimodal Image Generation
Authors: name: Team Seedream, name: Yunpeng Chen, name: Yu Gao, name: Lixue Gong, name: Meng Guo, name: Qiushan Guo, name: Zhiyao Guo, name: Xiaoxia Hou, name: Weilin Huang, name: Yixuan Huang, name: Xiaowen Jian, name: Huafeng Kuang, name: Zhichao Lai, name: Fanshi Li, name: Liang Li, name: Xiaochen Lian, name: Chao Liao, name: Liyang Liu, name: Wei Liu, name: Yanzuo Lu, name: Zhengxiong Luo, name: Tongtong Ou, name: Guang Shi, name: Yichun Shi, name: Shiqi Sun, name: Yu Tian, name: Zhi Tian, name: Peng Wang, name: Rui Wang, name: Xun Wang, name: Ye Wang, name: Guofeng Wu, name: Jie Wu, name: Wenxu Wu, name: Yonghui Wu, name: Xin Xia, name: Xuefeng Xiao, name: Shuang Xu, name: Xin Yan, name: Ceyuan Yang, name: Jianchao Yang, name: Zhonghua Zhai, name: Chenlin Zhang, name: Heng Zhang, name: Qi Zhang, name: Xinyu Zhang, name: Yuwei Zhang, name: Shijia Zhao, name: Wenliang Zhao, name: Wenjia Zhu

We introduce Seedream 4.0, an efficient and high-performance multimodal image
generation system that unifies text-to-image (T2I) synthesis, image editing,
and multi-image composition within a single framework. We develop a highly
efficient diffusion transformer with a powerful VAE which also can reduce the
number of image tokens considerably. This allows for efficient training of our
model, and enables it to fast generate native high-resolution images (e.g.,
1K-4K). Seedream 4.0 is pretrained on billions of text-image pairs spanning
diverse taxonomies and knowledge-centric concepts. Comprehensive data
collection across hundreds of vertical scenarios, coupled with optimized
strategies, ensures stable and large-scale training, with strong
generalization. By incorporating a carefully fine-tuned VLM model, we perform
multi-modal post-training for training both T2I and image editing tasks
jointly. For inference acceleration, we integrate adversarial distillation,
distribution matching, and quantization, as well as speculative decoding. It
achieves an inference time of up to 1.8 seconds for generating a 2K image
(without a LLM/VLM as PE model). Comprehensive evaluations reveal that Seedream
4.0 can achieve state-of-the-art results on both T2I and multimodal image
editing. In particular, it demonstrates exceptional multimodal capabilities in
complex tasks, including precise image editing and in-context reasoning, and
also allows for multi-image reference, and can generate multiple output images.
This extends traditional T2I systems into an more interactive and
multidimensional creative tool, pushing the boundary of generative AI for both
creativity and professional applications. Seedream 4.0 is now accessible on
https://www.volcengine.com/experience/ark?launch=seedream.