aykamko commited on
Commit
a1c2115
1 Parent(s): b58807a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Playground v2.5 – 1024px Aesthetic Model
2
+
3
+ This repository contains a model that generates highly aesthetic images of resolution 1024x1024. You can use the model with Hugging Face 🧨 Diffusers.
4
+
5
+ [insert teaser image]
6
+
7
+ **Playground v2.5** is a diffusion-based text-to-image generative model, and a successor to Playground v2 [link].
8
+
9
+ Playground v2.5 is near state-of-the-art in aesthetic quality. Our user studies demonstrate that our model outperforms SDXL, Playground v2, PIXART-alpha, DALL-E 3, and Midjourney 5.2.
10
+
11
+ For details on the development and training of our model, please refer to our blog post [link] and technical report [link]
12
+
13
+ ### Model Description
14
+ - **Developed by:** Playground
15
+ - **Model type:** Diffusion-based text-to-image generative model
16
+ - **License:** Playground v2 Community License
17
+ - **Summary:** This model generates images based on text prompts. It is a Latent Diffusion Model that uses two fixed, pre-trained text encoders (OpenCLIP-ViT/G and CLIP-ViT/L). It follows the same architecture as Stable Diffusion XL.
18
+
19
+ ### Using the model with 🧨 Diffusers
20
+ TODO
21
+
22
+ ### Using the model with Automatic1111/ComfyUI
23
+ TODO
24
+
25
+ ### User Studies
26
+
27
+ This model card only provides a brief summary of our user study results. For extensive details on how we perform user studies, please check out our technical report: [link]
28
+
29
+ We conducted studies to measure overall aesthetic quality, as well as for the specific areas we aimed to improve with Playground v2.5, namely multi aspect ratios and human preference alignment.
30
+
31
+ The aesthetic quality of Playground v2.5 dramatically outperforms the current state-of-the-art open source models SDXL and PIXART-α, as well as Playground v2. Because the performance differential between Playground V2.5 and SDXL was so large, we also tested our aesthetic quality against world-class closed-source models like DALL-E 3 and Midjourney 5.2, and found that Playground v2.5 outperforms them as well.
32
+
33
+ [insert graph for outperforming all of these models]
34
+
35
+ Similarly, for multi aspect ratios, we outperform SDXL by a large margin.
36
+
37
+ [insert graph for multi aspect ratios]
38
+
39
+ Next, we benchmark Playground v2.5 specifically on people-related images, to test Human Preference Alignment. We compared Playground v2.5 against two commonly-used baseline models: SDXL and RealStock v2, a community fine-tune of SDXL that was trained on a realistic people dataset.
40
+
41
+ Playground v2.5 outperforms both baselines by a large margin.
42
+
43
+ [insert graph for people prompts]
44
+
45
+ Lastly, we report metrics using our MJHQ-30K benchmark which we open-sourced with the v2 release. <link> We report both the overall FID and per category FID. All FID metrics are computed at resolution 1024x1024. Our results show that Playground v2.5 outperforms both Playground v2 and SDXL in overall FID and all category FIDs, especially in the people and fashion categories. This is in line with the results of the user study, which indicates a correlation between human preferences and the FID score of the MJHQ-30K benchmark.
46
+
47
+ [insert graph for MJHQ-30K benchmark]
48
+
49
+ ### How to cite us
50
+ TODO