hysts commited on
Commit
95b2a65
1 Parent(s): d854fce

Add README

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+ # CogView2
5
+ ## Model description
6
+
7
+ **CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers**
8
+
9
+ - [Paper](https://arxiv.org/abs/2204.14217)
10
+ - [GitHub Repo](https://github.com/THUDM/CogView2)
11
+
12
+ ### Abstract
13
+
14
+ The development of the transformer-based text-to-image models are impeded by its slow generation and complexity for high-resolution images. In this work, we put forward a solution based on hierarchical transformers and local parallel auto-regressive generation. We pretrain a 6B-parameter transformer with a simple and flexible self-supervised task, Cross-modal general language model (CogLM), and finetune it for fast super-resolution. The new text-to-image system, CogView2, shows very competitive generation compared to concurrent state-of-the-art DALL-E-2, and naturally supports interactive text-guided editing on images.
15
+
16
+ ## BibTeX entry and citation info
17
+ ```bibtex
18
+ @article{ding2022cogview2,
19
+ title={CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers},
20
+ author={Ding, Ming and Zheng, Wendi and Hong, Wenyi and Tang, Jie},
21
+ journal={arXiv preprint arXiv:2204.14217},
22
+ year={2022}
23
+ }
24
+ ```