Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
15
tianleliphoebe commited on
Commit
07bbd4d
•
1 Parent(s): 83e2394

update leaderboard

Browse files
Files changed (14) hide show
  1. arena_elo/edition_model_info.json +10 -0
  2. arena_elo/generation_model_info.json +10 -0
  3. arena_elo/results/20240516/clean_battle_image_editing.json +1578 -0
  4. arena_elo/results/20240516/elo_results_image_editing.pkl +3 -0
  5. arena_elo/results/20240516/image_editing_leaderboard.csv +10 -0
  6. arena_elo/results/20240517/clean_battle_t2i_generation.json +0 -0
  7. arena_elo/results/20240517/elo_results_t2i_generation.pkl +3 -0
  8. arena_elo/results/20240517/t2i_generation_leaderboard.csv +12 -0
  9. arena_elo/results/latest/clean_battle_image_editing.json +768 -0
  10. arena_elo/results/latest/clean_battle_t2i_generation.json +0 -0
  11. arena_elo/results/latest/elo_results_image_editing.pkl +2 -2
  12. arena_elo/results/latest/elo_results_t2i_generation.pkl +2 -2
  13. arena_elo/results/latest/image_editing_leaderboard.csv +9 -7
  14. arena_elo/results/latest/t2i_generation_leaderboard.csv +11 -10
arena_elo/edition_model_info.json CHANGED
@@ -33,5 +33,15 @@
33
  "Link": "https://sde-image-editing.github.io",
34
  "License": "MIT License",
35
  "Organization": "Stanford University"
 
 
 
 
 
 
 
 
 
 
36
  }
37
  }
 
33
  "Link": "https://sde-image-editing.github.io",
34
  "License": "MIT License",
35
  "Organization": "Stanford University"
36
+ },
37
+ "CosXLEdit": {
38
+ "Link": "https://huggingface.co/spaces/multimodalart/cosxl",
39
+ "License": "cosxl-nc-community",
40
+ "Organization": "Stability AI"
41
+ },
42
+ "InfEdit": {
43
+ "Link": "https://huggingface.co/spaces/sled-umich/InfEdit",
44
+ "License": "Apache-2.0",
45
+ "Organization": "University of Michigan, University of California, Berkeley"
46
  }
47
  }
arena_elo/generation_model_info.json CHANGED
@@ -43,5 +43,15 @@
43
  "Link": "https://huggingface.co/stabilityai/stable-cascade",
44
  "License": "stable-cascade-nc-community (other)",
45
  "Organization": "Stability AI"
 
 
 
 
 
 
 
 
 
 
46
  }
47
  }
 
43
  "Link": "https://huggingface.co/stabilityai/stable-cascade",
44
  "License": "stable-cascade-nc-community (other)",
45
  "Organization": "Stability AI"
46
+ },
47
+ "LCM(v1.5/XL)": {
48
+ "Link": "https://fal.ai/models/fal-ai/fast-lcm-diffusion/api",
49
+ "License": "openrail++",
50
+ "Organization": "Latent Consistency"
51
+ },
52
+ "PixArtSigma": {
53
+ "Link": "https://fal.ai/models/fal-ai/pixart-sigma",
54
+ "License": "openrail++",
55
+ "Organization": "PixArt-alpha"
56
  }
57
  }
arena_elo/results/20240516/clean_battle_image_editing.json ADDED
@@ -0,0 +1,1578 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "model_a": "CycleDiffusion",
4
+ "model_b": "InstructPix2Pix",
5
+ "winner": "model_b",
6
+ "judge": "arena_user_::1",
7
+ "anony": true,
8
+ "tstamp": 1707712630.872
9
+ },
10
+ {
11
+ "model_a": "CycleDiffusion",
12
+ "model_b": "InstructPix2Pix",
13
+ "winner": "model_b",
14
+ "judge": "arena_user_::1",
15
+ "anony": false,
16
+ "tstamp": 1707712699.668
17
+ },
18
+ {
19
+ "model_a": "Pix2PixZero",
20
+ "model_b": "MagicBrush",
21
+ "winner": "model_a",
22
+ "judge": "arena_user_::1",
23
+ "anony": true,
24
+ "tstamp": 1707712896.0427
25
+ },
26
+ {
27
+ "model_a": "CycleDiffusion",
28
+ "model_b": "InstructPix2Pix",
29
+ "winner": "model_b",
30
+ "judge": "arena_user_::1",
31
+ "anony": false,
32
+ "tstamp": 1707712929.7061
33
+ },
34
+ {
35
+ "model_a": "CycleDiffusion",
36
+ "model_b": "InstructPix2Pix",
37
+ "winner": "model_b",
38
+ "judge": "arena_user_::1",
39
+ "anony": true,
40
+ "tstamp": 1707713147.0445
41
+ },
42
+ {
43
+ "model_a": "CycleDiffusion",
44
+ "model_b": "PNP",
45
+ "winner": "model_b",
46
+ "judge": "arena_user_::1",
47
+ "anony": true,
48
+ "tstamp": 1707713198.9284
49
+ },
50
+ {
51
+ "model_a": "CycleDiffusion",
52
+ "model_b": "Prompt2prompt",
53
+ "winner": "model_b",
54
+ "judge": "arena_user_::1",
55
+ "anony": true,
56
+ "tstamp": 1707713210.1306
57
+ },
58
+ {
59
+ "model_a": "Prompt2prompt",
60
+ "model_b": "SDEdit",
61
+ "winner": "model_a",
62
+ "judge": "arena_user_::1",
63
+ "anony": true,
64
+ "tstamp": 1707713747.5115
65
+ },
66
+ {
67
+ "model_a": "PNP",
68
+ "model_b": "Pix2PixZero",
69
+ "winner": "model_a",
70
+ "judge": "arena_user_::1",
71
+ "anony": true,
72
+ "tstamp": 1707715613.7226
73
+ },
74
+ {
75
+ "model_a": "CycleDiffusion",
76
+ "model_b": "MagicBrush",
77
+ "winner": "model_b",
78
+ "judge": "arena_user_::1",
79
+ "anony": true,
80
+ "tstamp": 1707765708.2644
81
+ },
82
+ {
83
+ "model_a": "PNP",
84
+ "model_b": "CycleDiffusion",
85
+ "winner": "model_a",
86
+ "judge": "arena_user_::1",
87
+ "anony": true,
88
+ "tstamp": 1707765861.2742
89
+ },
90
+ {
91
+ "model_a": "PNP",
92
+ "model_b": "CycleDiffusion",
93
+ "winner": "model_a",
94
+ "judge": "arena_user_::1",
95
+ "anony": false,
96
+ "tstamp": 1707765975.0206
97
+ },
98
+ {
99
+ "model_a": "PNP",
100
+ "model_b": "CycleDiffusion",
101
+ "winner": "model_a",
102
+ "judge": "arena_user_::1",
103
+ "anony": true,
104
+ "tstamp": 1707768866.9065
105
+ },
106
+ {
107
+ "model_a": "SDEdit",
108
+ "model_b": "MagicBrush",
109
+ "winner": "model_b",
110
+ "judge": "arena_user_::1",
111
+ "anony": true,
112
+ "tstamp": 1707771673.2989
113
+ },
114
+ {
115
+ "model_a": "SDEdit",
116
+ "model_b": "MagicBrush",
117
+ "winner": "model_b",
118
+ "judge": "arena_user_::1",
119
+ "anony": true,
120
+ "tstamp": 1707784377.6617
121
+ },
122
+ {
123
+ "model_a": "SDEdit",
124
+ "model_b": "MagicBrush",
125
+ "winner": "model_b",
126
+ "judge": "arena_user_::1",
127
+ "anony": true,
128
+ "tstamp": 1707784466.8915
129
+ },
130
+ {
131
+ "model_a": "CycleDiffusion",
132
+ "model_b": "PNP",
133
+ "winner": "model_b",
134
+ "judge": "arena_user_::1",
135
+ "anony": true,
136
+ "tstamp": 1707784983.9581
137
+ },
138
+ {
139
+ "model_a": "MagicBrush",
140
+ "model_b": "SDEdit",
141
+ "winner": "model_a",
142
+ "judge": "arena_user_::1",
143
+ "anony": true,
144
+ "tstamp": 1707785277.16
145
+ },
146
+ {
147
+ "model_a": "MagicBrush",
148
+ "model_b": "SDEdit",
149
+ "winner": "model_a",
150
+ "judge": "arena_user_::1",
151
+ "anony": true,
152
+ "tstamp": 1707795299.0619
153
+ },
154
+ {
155
+ "model_a": "MagicBrush",
156
+ "model_b": "SDEdit",
157
+ "winner": "tie (bothbad)",
158
+ "judge": "arena_user_::1",
159
+ "anony": true,
160
+ "tstamp": 1707795798.752
161
+ },
162
+ {
163
+ "model_a": "SDEdit",
164
+ "model_b": "Prompt2prompt",
165
+ "winner": "model_b",
166
+ "judge": "arena_user_::1",
167
+ "anony": false,
168
+ "tstamp": 1707796435.7996
169
+ },
170
+ {
171
+ "model_a": "SDEdit",
172
+ "model_b": "CycleDiffusion",
173
+ "winner": "model_b",
174
+ "judge": "arena_user_::1",
175
+ "anony": false,
176
+ "tstamp": 1707797278.7369
177
+ },
178
+ {
179
+ "model_a": "SDEdit",
180
+ "model_b": "CycleDiffusion",
181
+ "winner": "model_a",
182
+ "judge": "arena_user_::1",
183
+ "anony": false,
184
+ "tstamp": 1707797279.6004
185
+ },
186
+ {
187
+ "model_a": "SDEdit",
188
+ "model_b": "Prompt2prompt",
189
+ "winner": "model_b",
190
+ "judge": "arena_user_::1",
191
+ "anony": true,
192
+ "tstamp": 1707805086.9739
193
+ },
194
+ {
195
+ "model_a": "PNP",
196
+ "model_b": "SDEdit",
197
+ "winner": "model_a",
198
+ "judge": "arena_user_::1",
199
+ "anony": true,
200
+ "tstamp": 1707805220.3253
201
+ },
202
+ {
203
+ "model_a": "InstructPix2Pix",
204
+ "model_b": "CycleDiffusion",
205
+ "winner": "tie (bothbad)",
206
+ "judge": "arena_user_::1",
207
+ "anony": true,
208
+ "tstamp": 1707805332.6322
209
+ },
210
+ {
211
+ "model_a": "InstructPix2Pix",
212
+ "model_b": "Prompt2prompt",
213
+ "winner": "model_b",
214
+ "judge": "arena_user_::1",
215
+ "anony": true,
216
+ "tstamp": 1707805476.0509
217
+ },
218
+ {
219
+ "model_a": "InstructPix2Pix",
220
+ "model_b": "Prompt2prompt",
221
+ "winner": "model_b",
222
+ "judge": "arena_user_::1",
223
+ "anony": true,
224
+ "tstamp": 1707818374.3438
225
+ },
226
+ {
227
+ "model_a": "PNP",
228
+ "model_b": "Prompt2prompt",
229
+ "winner": "model_b",
230
+ "judge": "arena_user_::1",
231
+ "anony": true,
232
+ "tstamp": 1707834631.9088
233
+ },
234
+ {
235
+ "model_a": "InstructPix2Pix",
236
+ "model_b": "SDEdit",
237
+ "winner": "model_a",
238
+ "judge": "arena_user_::1",
239
+ "anony": true,
240
+ "tstamp": 1707834954.0147
241
+ },
242
+ {
243
+ "model_a": "Prompt2prompt",
244
+ "model_b": "Pix2PixZero",
245
+ "winner": "tie (bothbad)",
246
+ "judge": "arena_user_::1",
247
+ "anony": true,
248
+ "tstamp": 1707835366.544
249
+ },
250
+ {
251
+ "model_a": "PNP",
252
+ "model_b": "SDEdit",
253
+ "winner": "model_a",
254
+ "judge": "arena_user_::1",
255
+ "anony": true,
256
+ "tstamp": 1707835643.6178
257
+ },
258
+ {
259
+ "model_a": "MagicBrush",
260
+ "model_b": "InstructPix2Pix",
261
+ "winner": "tie (bothbad)",
262
+ "judge": "arena_user_::1",
263
+ "anony": true,
264
+ "tstamp": 1707835789.25
265
+ },
266
+ {
267
+ "model_a": "MagicBrush",
268
+ "model_b": "PNP",
269
+ "winner": "tie (bothbad)",
270
+ "judge": "arena_user_::1",
271
+ "anony": true,
272
+ "tstamp": 1707836852.671
273
+ },
274
+ {
275
+ "model_a": "MagicBrush",
276
+ "model_b": "InstructPix2Pix",
277
+ "winner": "model_a",
278
+ "judge": "arena_user_::1",
279
+ "anony": false,
280
+ "tstamp": 1707836952.6082
281
+ },
282
+ {
283
+ "model_a": "CycleDiffusion",
284
+ "model_b": "SDEdit",
285
+ "winner": "tie (bothbad)",
286
+ "judge": "arena_user_::1",
287
+ "anony": false,
288
+ "tstamp": 1707837020.7148
289
+ },
290
+ {
291
+ "model_a": "InstructPix2Pix",
292
+ "model_b": "PNP",
293
+ "winner": "model_a",
294
+ "judge": "arena_user_::1",
295
+ "anony": true,
296
+ "tstamp": 1707837226.2259
297
+ },
298
+ {
299
+ "model_a": "Prompt2prompt",
300
+ "model_b": "Pix2PixZero",
301
+ "winner": "model_a",
302
+ "judge": "arena_user_::1",
303
+ "anony": true,
304
+ "tstamp": 1707838166.1449
305
+ },
306
+ {
307
+ "model_a": "InstructPix2Pix",
308
+ "model_b": "MagicBrush",
309
+ "winner": "tie (bothbad)",
310
+ "judge": "arena_user_::1",
311
+ "anony": true,
312
+ "tstamp": 1707838405.0013
313
+ },
314
+ {
315
+ "model_a": "MagicBrush",
316
+ "model_b": "CycleDiffusion",
317
+ "winner": "model_a",
318
+ "judge": "arena_user_::1",
319
+ "anony": true,
320
+ "tstamp": 1707839133.3126
321
+ },
322
+ {
323
+ "model_a": "Prompt2prompt",
324
+ "model_b": "InstructPix2Pix",
325
+ "winner": "model_a",
326
+ "judge": "arena_user_::1",
327
+ "anony": true,
328
+ "tstamp": 1707839484.6824
329
+ },
330
+ {
331
+ "model_a": "PNP",
332
+ "model_b": "InstructPix2Pix",
333
+ "winner": "tie (bothbad)",
334
+ "judge": "arena_user_::1",
335
+ "anony": true,
336
+ "tstamp": 1707850104.2499
337
+ },
338
+ {
339
+ "model_a": "InstructPix2Pix",
340
+ "model_b": "Pix2PixZero",
341
+ "winner": "model_a",
342
+ "judge": "arena_user_::1",
343
+ "anony": true,
344
+ "tstamp": 1707851384.7689
345
+ },
346
+ {
347
+ "model_a": "PNP",
348
+ "model_b": "MagicBrush",
349
+ "winner": "model_b",
350
+ "judge": "arena_user_::1",
351
+ "anony": true,
352
+ "tstamp": 1707851936.9466
353
+ },
354
+ {
355
+ "model_a": "CycleDiffusion",
356
+ "model_b": "MagicBrush",
357
+ "winner": "tie (bothbad)",
358
+ "judge": "arena_user_::1",
359
+ "anony": true,
360
+ "tstamp": 1707852836.3291
361
+ },
362
+ {
363
+ "model_a": "CycleDiffusion",
364
+ "model_b": "MagicBrush",
365
+ "winner": "tie (bothbad)",
366
+ "judge": "arena_user_::1",
367
+ "anony": false,
368
+ "tstamp": 1707852878.673
369
+ },
370
+ {
371
+ "model_a": "Prompt2prompt",
372
+ "model_b": "InstructPix2Pix",
373
+ "winner": "model_a",
374
+ "judge": "arena_user_::1",
375
+ "anony": true,
376
+ "tstamp": 1707853008.1359
377
+ },
378
+ {
379
+ "model_a": "InstructPix2Pix",
380
+ "model_b": "Pix2PixZero",
381
+ "winner": "model_a",
382
+ "judge": "arena_user_::1",
383
+ "anony": false,
384
+ "tstamp": 1707856807.6229
385
+ },
386
+ {
387
+ "model_a": "MagicBrush",
388
+ "model_b": "Pix2PixZero",
389
+ "winner": "tie (bothbad)",
390
+ "judge": "arena_user_::1",
391
+ "anony": false,
392
+ "tstamp": 1707863740.3507
393
+ },
394
+ {
395
+ "model_a": "MagicBrush",
396
+ "model_b": "PNP",
397
+ "winner": "model_b",
398
+ "judge": "arena_user_::1",
399
+ "anony": true,
400
+ "tstamp": 1707866312.1118
401
+ },
402
+ {
403
+ "model_a": "Pix2PixZero",
404
+ "model_b": "Prompt2prompt",
405
+ "winner": "model_b",
406
+ "judge": "arena_user_::1",
407
+ "anony": true,
408
+ "tstamp": 1707883083.3533
409
+ },
410
+ {
411
+ "model_a": "Pix2PixZero",
412
+ "model_b": "InstructPix2Pix",
413
+ "winner": "model_b",
414
+ "judge": "arena_user_::1",
415
+ "anony": true,
416
+ "tstamp": 1707883181.1397
417
+ },
418
+ {
419
+ "model_a": "Pix2PixZero",
420
+ "model_b": "Prompt2prompt",
421
+ "winner": "model_b",
422
+ "judge": "arena_user_::1",
423
+ "anony": true,
424
+ "tstamp": 1707883187.9173
425
+ },
426
+ {
427
+ "model_a": "PNP",
428
+ "model_b": "Prompt2prompt",
429
+ "winner": "model_a",
430
+ "judge": "arena_user_::1",
431
+ "anony": true,
432
+ "tstamp": 1707883507.587
433
+ },
434
+ {
435
+ "model_a": "Prompt2prompt",
436
+ "model_b": "CycleDiffusion",
437
+ "winner": "model_a",
438
+ "judge": "arena_user_::1",
439
+ "anony": true,
440
+ "tstamp": 1707883939.6125
441
+ },
442
+ {
443
+ "model_a": "Prompt2prompt",
444
+ "model_b": "MagicBrush",
445
+ "winner": "model_b",
446
+ "judge": "arena_user_::1",
447
+ "anony": true,
448
+ "tstamp": 1707892689.4407
449
+ },
450
+ {
451
+ "model_a": "MagicBrush",
452
+ "model_b": "InstructPix2Pix",
453
+ "winner": "model_b",
454
+ "judge": "arena_user_::1",
455
+ "anony": true,
456
+ "tstamp": 1707908988.749
457
+ },
458
+ {
459
+ "model_a": "Prompt2prompt",
460
+ "model_b": "InstructPix2Pix",
461
+ "winner": "model_a",
462
+ "judge": "arena_user_::1",
463
+ "anony": true,
464
+ "tstamp": 1707912639.2701
465
+ },
466
+ {
467
+ "model_a": "MagicBrush",
468
+ "model_b": "Pix2PixZero",
469
+ "winner": "model_a",
470
+ "judge": "arena_user_::1",
471
+ "anony": false,
472
+ "tstamp": 1707917685.9574
473
+ },
474
+ {
475
+ "model_a": "MagicBrush",
476
+ "model_b": "InstructPix2Pix",
477
+ "winner": "tie (bothbad)",
478
+ "judge": "arena_user_::1",
479
+ "anony": false,
480
+ "tstamp": 1707919429.336
481
+ },
482
+ {
483
+ "model_a": "InstructPix2Pix",
484
+ "model_b": "CycleDiffusion",
485
+ "winner": "model_a",
486
+ "judge": "arena_user_::1",
487
+ "anony": true,
488
+ "tstamp": 1707932651.9192
489
+ },
490
+ {
491
+ "model_a": "MagicBrush",
492
+ "model_b": "InstructPix2Pix",
493
+ "winner": "model_a",
494
+ "judge": "arena_user_::1",
495
+ "anony": true,
496
+ "tstamp": 1707932749.3107
497
+ },
498
+ {
499
+ "model_a": "Prompt2prompt",
500
+ "model_b": "PNP",
501
+ "winner": "model_a",
502
+ "judge": "arena_user_::1",
503
+ "anony": true,
504
+ "tstamp": 1707933208.5797
505
+ },
506
+ {
507
+ "model_a": "MagicBrush",
508
+ "model_b": "Pix2PixZero",
509
+ "winner": "model_a",
510
+ "judge": "arena_user_::1",
511
+ "anony": false,
512
+ "tstamp": 1707945335.6341
513
+ },
514
+ {
515
+ "model_a": "MagicBrush",
516
+ "model_b": "PNP",
517
+ "winner": "model_a",
518
+ "judge": "arena_user_::1",
519
+ "anony": false,
520
+ "tstamp": 1708031168.6838
521
+ },
522
+ {
523
+ "model_a": "Pix2PixZero",
524
+ "model_b": "PNP",
525
+ "winner": "model_b",
526
+ "judge": "arena_user_::1",
527
+ "anony": false,
528
+ "tstamp": 1708038931.5388
529
+ },
530
+ {
531
+ "model_a": "Pix2PixZero",
532
+ "model_b": "CycleDiffusion",
533
+ "winner": "tie (bothbad)",
534
+ "judge": "arena_user_::1",
535
+ "anony": true,
536
+ "tstamp": 1708057382.78
537
+ },
538
+ {
539
+ "model_a": "PNP",
540
+ "model_b": "InstructPix2Pix",
541
+ "winner": "model_b",
542
+ "judge": "arena_user_::1",
543
+ "anony": true,
544
+ "tstamp": 1708093689.8237
545
+ },
546
+ {
547
+ "model_a": "MagicBrush",
548
+ "model_b": "PNP",
549
+ "winner": "model_b",
550
+ "judge": "arena_user_::1",
551
+ "anony": true,
552
+ "tstamp": 1708093910.4683
553
+ },
554
+ {
555
+ "model_a": "Pix2PixZero",
556
+ "model_b": "Prompt2prompt",
557
+ "winner": "model_b",
558
+ "judge": "arena_user_::1",
559
+ "anony": false,
560
+ "tstamp": 1708095090.8232
561
+ },
562
+ {
563
+ "model_a": "Pix2PixZero",
564
+ "model_b": "Prompt2prompt",
565
+ "winner": "model_a",
566
+ "judge": "arena_user_::1",
567
+ "anony": false,
568
+ "tstamp": 1708095305.4665
569
+ },
570
+ {
571
+ "model_a": "InstructPix2Pix",
572
+ "model_b": "Prompt2prompt",
573
+ "winner": "model_b",
574
+ "judge": "arena_user_::1",
575
+ "anony": true,
576
+ "tstamp": 1708140553.1694
577
+ },
578
+ {
579
+ "model_a": "MagicBrush",
580
+ "model_b": "Prompt2prompt",
581
+ "winner": "model_a",
582
+ "judge": "arena_user_::1",
583
+ "anony": true,
584
+ "tstamp": 1708145512.3656
585
+ },
586
+ {
587
+ "model_a": "Pix2PixZero",
588
+ "model_b": "Prompt2prompt",
589
+ "winner": "tie (bothbad)",
590
+ "judge": "arena_user_::1",
591
+ "anony": true,
592
+ "tstamp": 1708145724.4127
593
+ },
594
+ {
595
+ "model_a": "Pix2PixZero",
596
+ "model_b": "PNP",
597
+ "winner": "model_b",
598
+ "judge": "arena_user_::1",
599
+ "anony": true,
600
+ "tstamp": 1708146846.5098
601
+ },
602
+ {
603
+ "model_a": "PNP",
604
+ "model_b": "MagicBrush",
605
+ "winner": "model_a",
606
+ "judge": "arena_user_::1",
607
+ "anony": true,
608
+ "tstamp": 1708189738.4864
609
+ },
610
+ {
611
+ "model_a": "Prompt2prompt",
612
+ "model_b": "InstructPix2Pix",
613
+ "winner": "model_b",
614
+ "judge": "arena_user_::1",
615
+ "anony": true,
616
+ "tstamp": 1708235874.9246
617
+ },
618
+ {
619
+ "model_a": "Pix2PixZero",
620
+ "model_b": "PNP",
621
+ "winner": "model_b",
622
+ "judge": "arena_user_::1",
623
+ "anony": false,
624
+ "tstamp": 1708257619.7115
625
+ },
626
+ {
627
+ "model_a": "MagicBrush",
628
+ "model_b": "Pix2PixZero",
629
+ "winner": "tie (bothbad)",
630
+ "judge": "arena_user_::1",
631
+ "anony": true,
632
+ "tstamp": 1708341265.7655
633
+ },
634
+ {
635
+ "model_a": "MagicBrush",
636
+ "model_b": "InstructPix2Pix",
637
+ "winner": "model_b",
638
+ "judge": "arena_user_::1",
639
+ "anony": true,
640
+ "tstamp": 1708350183.3086
641
+ },
642
+ {
643
+ "model_a": "MagicBrush",
644
+ "model_b": "Pix2PixZero",
645
+ "winner": "tie (bothbad)",
646
+ "judge": "arena_user_::1",
647
+ "anony": true,
648
+ "tstamp": 1708399707.1681
649
+ },
650
+ {
651
+ "model_a": "PNP",
652
+ "model_b": "MagicBrush",
653
+ "winner": "model_a",
654
+ "judge": "arena_user_::1",
655
+ "anony": true,
656
+ "tstamp": 1708441502.4707
657
+ },
658
+ {
659
+ "model_a": "InstructPix2Pix",
660
+ "model_b": "MagicBrush",
661
+ "winner": "model_a",
662
+ "judge": "arena_user_::1",
663
+ "anony": true,
664
+ "tstamp": 1708441716.8195
665
+ },
666
+ {
667
+ "model_a": "InstructPix2Pix",
668
+ "model_b": "MagicBrush",
669
+ "winner": "model_b",
670
+ "judge": "arena_user_::1",
671
+ "anony": false,
672
+ "tstamp": 1708546759.2009
673
+ },
674
+ {
675
+ "model_a": "InstructPix2Pix",
676
+ "model_b": "MagicBrush",
677
+ "winner": "model_a",
678
+ "judge": "arena_user_::1",
679
+ "anony": false,
680
+ "tstamp": 1708546805.4892
681
+ },
682
+ {
683
+ "model_a": "Pix2PixZero",
684
+ "model_b": "CycleDiffusion",
685
+ "winner": "tie (bothbad)",
686
+ "judge": "arena_user_::1",
687
+ "anony": true,
688
+ "tstamp": 1708547082.7124
689
+ },
690
+ {
691
+ "model_a": "InstructPix2Pix",
692
+ "model_b": "MagicBrush",
693
+ "winner": "model_b",
694
+ "judge": "arena_user_::1",
695
+ "anony": false,
696
+ "tstamp": 1708547166.9685
697
+ },
698
+ {
699
+ "model_a": "InstructPix2Pix",
700
+ "model_b": "MagicBrush",
701
+ "winner": "model_b",
702
+ "judge": "arena_user_::1",
703
+ "anony": false,
704
+ "tstamp": 1708547293.7107
705
+ },
706
+ {
707
+ "model_a": "CycleDiffusion",
708
+ "model_b": "PNP",
709
+ "winner": "tie (bothbad)",
710
+ "judge": "arena_user_::1",
711
+ "anony": true,
712
+ "tstamp": 1708575046.0529
713
+ },
714
+ {
715
+ "model_a": "CycleDiffusion",
716
+ "model_b": "MagicBrush",
717
+ "winner": "tie (bothbad)",
718
+ "judge": "arena_user_::1",
719
+ "anony": true,
720
+ "tstamp": 1708615466.9264
721
+ },
722
+ {
723
+ "model_a": "CycleDiffusion",
724
+ "model_b": "MagicBrush",
725
+ "winner": "model_b",
726
+ "judge": "arena_user_::1",
727
+ "anony": false,
728
+ "tstamp": 1708615516.3341
729
+ },
730
+ {
731
+ "model_a": "InstructPix2Pix",
732
+ "model_b": "PNP",
733
+ "winner": "model_b",
734
+ "judge": "arena_user_::1",
735
+ "anony": false,
736
+ "tstamp": 1709205399.0098
737
+ },
738
+ {
739
+ "model_a": "InstructPix2Pix",
740
+ "model_b": "PNP",
741
+ "winner": "model_b",
742
+ "judge": "arena_user_::1",
743
+ "anony": false,
744
+ "tstamp": 1709205767.8923
745
+ },
746
+ {
747
+ "model_a": "PNP",
748
+ "model_b": "InstructPix2Pix",
749
+ "winner": "model_b",
750
+ "judge": "arena_user_::1",
751
+ "anony": true,
752
+ "tstamp": 1709443700.05
753
+ },
754
+ {
755
+ "model_a": "MagicBrush",
756
+ "model_b": "Pix2PixZero",
757
+ "winner": "model_a",
758
+ "judge": "arena_user_::1",
759
+ "anony": true,
760
+ "tstamp": 1709702898.9291
761
+ },
762
+ {
763
+ "model_a": "CycleDiffusion",
764
+ "model_b": "Prompt2prompt",
765
+ "winner": "tie (bothbad)",
766
+ "judge": "arena_user_::1",
767
+ "anony": true,
768
+ "tstamp": 1710091925.1861
769
+ },
770
+ {
771
+ "model_a": "MagicBrush",
772
+ "model_b": "InstructPix2Pix",
773
+ "winner": "tie (bothbad)",
774
+ "judge": "arena_user_::1",
775
+ "anony": true,
776
+ "tstamp": 1710517781.1525
777
+ },
778
+ {
779
+ "model_a": "MagicBrush",
780
+ "model_b": "InstructPix2Pix",
781
+ "winner": "tie (bothbad)",
782
+ "judge": "arena_user_::1",
783
+ "anony": false,
784
+ "tstamp": 1710517859.2942
785
+ },
786
+ {
787
+ "model_a": "Pix2PixZero",
788
+ "model_b": "CycleDiffusion",
789
+ "winner": "tie (bothbad)",
790
+ "judge": "arena_user_::1",
791
+ "anony": true,
792
+ "tstamp": 1710535672.9791
793
+ },
794
+ {
795
+ "model_a": "InfEdit",
796
+ "model_b": "MagicBrush",
797
+ "winner": "model_a",
798
+ "judge": "arena_user_10.16.25.191",
799
+ "anony": false,
800
+ "tstamp": 1714359818.6646
801
+ },
802
+ {
803
+ "model_a": "InstructPix2Pix",
804
+ "model_b": "Prompt2prompt",
805
+ "winner": "tie (bothbad)",
806
+ "judge": "arena_user_10.16.25.191",
807
+ "anony": true,
808
+ "tstamp": 1714363016.9972
809
+ },
810
+ {
811
+ "model_a": "InfEdit",
812
+ "model_b": "CosXLEdit",
813
+ "winner": "model_a",
814
+ "judge": "arena_user_10.16.25.191",
815
+ "anony": true,
816
+ "tstamp": 1714715956.3416
817
+ },
818
+ {
819
+ "model_a": "Pix2PixZero",
820
+ "model_b": "Prompt2prompt",
821
+ "winner": "tie (bothbad)",
822
+ "judge": "arena_user_10.16.2.201",
823
+ "anony": false,
824
+ "tstamp": 1714759928.3804
825
+ },
826
+ {
827
+ "model_a": "PNP",
828
+ "model_b": "InstructPix2Pix",
829
+ "winner": "model_a",
830
+ "judge": "arena_user_10.16.17.217",
831
+ "anony": true,
832
+ "tstamp": 1715246275.0118
833
+ },
834
+ {
835
+ "model_a": "SDEdit",
836
+ "model_b": "CosXLEdit",
837
+ "winner": "tie (bothbad)",
838
+ "judge": "arena_user_10.16.15.199",
839
+ "anony": true,
840
+ "tstamp": 1715247590.2235
841
+ },
842
+ {
843
+ "model_a": "CycleDiffusion",
844
+ "model_b": "CosXLEdit",
845
+ "winner": "model_b",
846
+ "judge": "arena_user_10.16.41.118",
847
+ "anony": false,
848
+ "tstamp": 1715406266.2562
849
+ },
850
+ {
851
+ "model_a": "CycleDiffusion",
852
+ "model_b": "CosXLEdit",
853
+ "winner": "model_a",
854
+ "judge": "arena_user_10.16.41.118",
855
+ "anony": false,
856
+ "tstamp": 1715406354.5284
857
+ },
858
+ {
859
+ "model_a": "CycleDiffusion",
860
+ "model_b": "CosXLEdit",
861
+ "winner": "model_b",
862
+ "judge": "arena_user_10.16.2.201",
863
+ "anony": false,
864
+ "tstamp": 1715406371.8227
865
+ },
866
+ {
867
+ "model_a": "CycleDiffusion",
868
+ "model_b": "CosXLEdit",
869
+ "winner": "model_b",
870
+ "judge": "arena_user_10.16.41.118",
871
+ "anony": false,
872
+ "tstamp": 1715406418.5066
873
+ },
874
+ {
875
+ "model_a": "CycleDiffusion",
876
+ "model_b": "CosXLEdit",
877
+ "winner": "model_b",
878
+ "judge": "arena_user_10.16.25.191",
879
+ "anony": false,
880
+ "tstamp": 1715406449.9401
881
+ },
882
+ {
883
+ "model_a": "CycleDiffusion",
884
+ "model_b": "CosXLEdit",
885
+ "winner": "model_b",
886
+ "judge": "arena_user_10.16.41.118",
887
+ "anony": false,
888
+ "tstamp": 1715406466.5778
889
+ },
890
+ {
891
+ "model_a": "InfEdit",
892
+ "model_b": "CycleDiffusion",
893
+ "winner": "model_a",
894
+ "judge": "arena_user_10.16.2.201",
895
+ "anony": true,
896
+ "tstamp": 1715620708.6361
897
+ },
898
+ {
899
+ "model_a": "Prompt2prompt",
900
+ "model_b": "CosXLEdit",
901
+ "winner": "model_a",
902
+ "judge": "arena_user_10.16.41.118",
903
+ "anony": false,
904
+ "tstamp": 1715621013.5373
905
+ },
906
+ {
907
+ "model_a": "MagicBrush",
908
+ "model_b": "CycleDiffusion",
909
+ "winner": "tie (bothbad)",
910
+ "judge": "arena_user_10.16.2.201",
911
+ "anony": true,
912
+ "tstamp": 1715661224.0507
913
+ },
914
+ {
915
+ "model_a": "SDEdit",
916
+ "model_b": "PNP",
917
+ "winner": "tie (bothbad)",
918
+ "judge": "arena_user_10.16.41.118",
919
+ "anony": true,
920
+ "tstamp": 1715661259.6143
921
+ },
922
+ {
923
+ "model_a": "Pix2PixZero",
924
+ "model_b": "Prompt2prompt",
925
+ "winner": "tie (bothbad)",
926
+ "judge": "arena_user_10.16.41.118",
927
+ "anony": true,
928
+ "tstamp": 1715661288.6018
929
+ },
930
+ {
931
+ "model_a": "InstructPix2Pix",
932
+ "model_b": "Prompt2prompt",
933
+ "winner": "model_b",
934
+ "judge": "arena_user_10.16.25.191",
935
+ "anony": true,
936
+ "tstamp": 1715661310.3621
937
+ },
938
+ {
939
+ "model_a": "CosXLEdit",
940
+ "model_b": "InstructPix2Pix",
941
+ "winner": "tie (bothbad)",
942
+ "judge": "arena_user_10.16.25.191",
943
+ "anony": true,
944
+ "tstamp": 1715718742.1258
945
+ },
946
+ {
947
+ "model_a": "MagicBrush",
948
+ "model_b": "PNP",
949
+ "winner": "model_a",
950
+ "judge": "arena_user_10.16.2.201",
951
+ "anony": true,
952
+ "tstamp": 1715718773.1054
953
+ },
954
+ {
955
+ "model_a": "SDEdit",
956
+ "model_b": "CosXLEdit",
957
+ "winner": "tie (bothbad)",
958
+ "judge": "arena_user_10.16.2.201",
959
+ "anony": true,
960
+ "tstamp": 1715718785.2832
961
+ },
962
+ {
963
+ "model_a": "InstructPix2Pix",
964
+ "model_b": "SDEdit",
965
+ "winner": "tie (bothbad)",
966
+ "judge": "arena_user_10.16.2.201",
967
+ "anony": true,
968
+ "tstamp": 1715718804.143
969
+ },
970
+ {
971
+ "model_a": "InfEdit",
972
+ "model_b": "CosXLEdit",
973
+ "winner": "model_b",
974
+ "judge": "arena_user_10.16.25.191",
975
+ "anony": true,
976
+ "tstamp": 1715718826.0248
977
+ },
978
+ {
979
+ "model_a": "InfEdit",
980
+ "model_b": "Prompt2prompt",
981
+ "winner": "model_a",
982
+ "judge": "arena_user_10.16.2.201",
983
+ "anony": true,
984
+ "tstamp": 1715718869.0041
985
+ },
986
+ {
987
+ "model_a": "InfEdit",
988
+ "model_b": "CosXLEdit",
989
+ "winner": "model_b",
990
+ "judge": "arena_user_10.16.2.201",
991
+ "anony": true,
992
+ "tstamp": 1715718904.9307
993
+ },
994
+ {
995
+ "model_a": "Prompt2prompt",
996
+ "model_b": "Pix2PixZero",
997
+ "winner": "model_a",
998
+ "judge": "arena_user_10.16.25.191",
999
+ "anony": true,
1000
+ "tstamp": 1715718933.1272
1001
+ },
1002
+ {
1003
+ "model_a": "Pix2PixZero",
1004
+ "model_b": "MagicBrush",
1005
+ "winner": "tie (bothbad)",
1006
+ "judge": "arena_user_10.16.2.201",
1007
+ "anony": true,
1008
+ "tstamp": 1715718954.8497
1009
+ },
1010
+ {
1011
+ "model_a": "MagicBrush",
1012
+ "model_b": "PNP",
1013
+ "winner": "model_b",
1014
+ "judge": "arena_user_10.16.25.191",
1015
+ "anony": true,
1016
+ "tstamp": 1715718966.8633
1017
+ },
1018
+ {
1019
+ "model_a": "CycleDiffusion",
1020
+ "model_b": "Prompt2prompt",
1021
+ "winner": "tie (bothbad)",
1022
+ "judge": "arena_user_10.16.25.191",
1023
+ "anony": true,
1024
+ "tstamp": 1715719000.6673
1025
+ },
1026
+ {
1027
+ "model_a": "MagicBrush",
1028
+ "model_b": "Pix2PixZero",
1029
+ "winner": "tie (bothbad)",
1030
+ "judge": "arena_user_10.16.25.191",
1031
+ "anony": true,
1032
+ "tstamp": 1715719019.5495
1033
+ },
1034
+ {
1035
+ "model_a": "InfEdit",
1036
+ "model_b": "Prompt2prompt",
1037
+ "winner": "model_a",
1038
+ "judge": "arena_user_10.16.25.191",
1039
+ "anony": true,
1040
+ "tstamp": 1715719035.903
1041
+ },
1042
+ {
1043
+ "model_a": "MagicBrush",
1044
+ "model_b": "Pix2PixZero",
1045
+ "winner": "model_a",
1046
+ "judge": "arena_user_10.16.25.191",
1047
+ "anony": true,
1048
+ "tstamp": 1715719046.925
1049
+ },
1050
+ {
1051
+ "model_a": "CycleDiffusion",
1052
+ "model_b": "CosXLEdit",
1053
+ "winner": "tie (bothbad)",
1054
+ "judge": "arena_user_10.16.2.201",
1055
+ "anony": true,
1056
+ "tstamp": 1715719059.6291
1057
+ },
1058
+ {
1059
+ "model_a": "Prompt2prompt",
1060
+ "model_b": "SDEdit",
1061
+ "winner": "tie (bothbad)",
1062
+ "judge": "arena_user_10.16.15.199",
1063
+ "anony": true,
1064
+ "tstamp": 1715719076.6727
1065
+ },
1066
+ {
1067
+ "model_a": "MagicBrush",
1068
+ "model_b": "PNP",
1069
+ "winner": "model_a",
1070
+ "judge": "arena_user_10.16.25.191",
1071
+ "anony": true,
1072
+ "tstamp": 1715719086.7836
1073
+ },
1074
+ {
1075
+ "model_a": "CycleDiffusion",
1076
+ "model_b": "MagicBrush",
1077
+ "winner": "model_b",
1078
+ "judge": "arena_user_10.16.25.191",
1079
+ "anony": true,
1080
+ "tstamp": 1715719109.8071
1081
+ },
1082
+ {
1083
+ "model_a": "Prompt2prompt",
1084
+ "model_b": "InstructPix2Pix",
1085
+ "winner": "model_b",
1086
+ "judge": "arena_user_10.16.25.191",
1087
+ "anony": true,
1088
+ "tstamp": 1715719122.8237
1089
+ },
1090
+ {
1091
+ "model_a": "MagicBrush",
1092
+ "model_b": "SDEdit",
1093
+ "winner": "model_a",
1094
+ "judge": "arena_user_10.16.15.199",
1095
+ "anony": true,
1096
+ "tstamp": 1715719134.1345
1097
+ },
1098
+ {
1099
+ "model_a": "SDEdit",
1100
+ "model_b": "CycleDiffusion",
1101
+ "winner": "tie (bothbad)",
1102
+ "judge": "arena_user_10.16.17.217",
1103
+ "anony": true,
1104
+ "tstamp": 1715719153.4359
1105
+ },
1106
+ {
1107
+ "model_a": "Pix2PixZero",
1108
+ "model_b": "MagicBrush",
1109
+ "winner": "tie (bothbad)",
1110
+ "judge": "arena_user_10.16.17.217",
1111
+ "anony": true,
1112
+ "tstamp": 1715719160.5285
1113
+ },
1114
+ {
1115
+ "model_a": "MagicBrush",
1116
+ "model_b": "InstructPix2Pix",
1117
+ "winner": "model_b",
1118
+ "judge": "arena_user_10.16.15.199",
1119
+ "anony": true,
1120
+ "tstamp": 1715719171.4473
1121
+ },
1122
+ {
1123
+ "model_a": "InstructPix2Pix",
1124
+ "model_b": "SDEdit",
1125
+ "winner": "tie (bothbad)",
1126
+ "judge": "arena_user_10.16.2.201",
1127
+ "anony": true,
1128
+ "tstamp": 1715719184.6227
1129
+ },
1130
+ {
1131
+ "model_a": "CosXLEdit",
1132
+ "model_b": "MagicBrush",
1133
+ "winner": "model_a",
1134
+ "judge": "arena_user_10.16.2.201",
1135
+ "anony": true,
1136
+ "tstamp": 1715719210.0429
1137
+ },
1138
+ {
1139
+ "model_a": "CycleDiffusion",
1140
+ "model_b": "MagicBrush",
1141
+ "winner": "model_b",
1142
+ "judge": "arena_user_10.16.41.118",
1143
+ "anony": true,
1144
+ "tstamp": 1715719219.6447
1145
+ },
1146
+ {
1147
+ "model_a": "PNP",
1148
+ "model_b": "Pix2PixZero",
1149
+ "winner": "tie (bothbad)",
1150
+ "judge": "arena_user_10.16.41.118",
1151
+ "anony": true,
1152
+ "tstamp": 1715719237.7036
1153
+ },
1154
+ {
1155
+ "model_a": "PNP",
1156
+ "model_b": "CycleDiffusion",
1157
+ "winner": "tie (bothbad)",
1158
+ "judge": "arena_user_10.16.25.191",
1159
+ "anony": true,
1160
+ "tstamp": 1715719249.4321
1161
+ },
1162
+ {
1163
+ "model_a": "Prompt2prompt",
1164
+ "model_b": "Pix2PixZero",
1165
+ "winner": "model_a",
1166
+ "judge": "arena_user_10.16.2.201",
1167
+ "anony": true,
1168
+ "tstamp": 1715719257.5877
1169
+ },
1170
+ {
1171
+ "model_a": "CosXLEdit",
1172
+ "model_b": "Pix2PixZero",
1173
+ "winner": "tie (bothbad)",
1174
+ "judge": "arena_user_10.16.25.191",
1175
+ "anony": true,
1176
+ "tstamp": 1715719273.7637
1177
+ },
1178
+ {
1179
+ "model_a": "PNP",
1180
+ "model_b": "CosXLEdit",
1181
+ "winner": "model_b",
1182
+ "judge": "arena_user_10.16.17.217",
1183
+ "anony": true,
1184
+ "tstamp": 1715719288.4629
1185
+ },
1186
+ {
1187
+ "model_a": "Pix2PixZero",
1188
+ "model_b": "PNP",
1189
+ "winner": "model_b",
1190
+ "judge": "arena_user_10.16.41.118",
1191
+ "anony": true,
1192
+ "tstamp": 1715719299.1712
1193
+ },
1194
+ {
1195
+ "model_a": "PNP",
1196
+ "model_b": "MagicBrush",
1197
+ "winner": "model_b",
1198
+ "judge": "arena_user_10.16.2.201",
1199
+ "anony": true,
1200
+ "tstamp": 1715719306.5928
1201
+ },
1202
+ {
1203
+ "model_a": "InstructPix2Pix",
1204
+ "model_b": "PNP",
1205
+ "winner": "tie (bothbad)",
1206
+ "judge": "arena_user_10.16.15.199",
1207
+ "anony": true,
1208
+ "tstamp": 1715719356.0694
1209
+ },
1210
+ {
1211
+ "model_a": "Prompt2prompt",
1212
+ "model_b": "CosXLEdit",
1213
+ "winner": "model_a",
1214
+ "judge": "arena_user_10.16.25.191",
1215
+ "anony": true,
1216
+ "tstamp": 1715719368.0491
1217
+ },
1218
+ {
1219
+ "model_a": "Prompt2prompt",
1220
+ "model_b": "CycleDiffusion",
1221
+ "winner": "tie (bothbad)",
1222
+ "judge": "arena_user_10.16.41.118",
1223
+ "anony": true,
1224
+ "tstamp": 1715719379.185
1225
+ },
1226
+ {
1227
+ "model_a": "CycleDiffusion",
1228
+ "model_b": "Prompt2prompt",
1229
+ "winner": "tie (bothbad)",
1230
+ "judge": "arena_user_10.16.2.201",
1231
+ "anony": true,
1232
+ "tstamp": 1715719389.0771
1233
+ },
1234
+ {
1235
+ "model_a": "Pix2PixZero",
1236
+ "model_b": "MagicBrush",
1237
+ "winner": "model_b",
1238
+ "judge": "arena_user_10.16.17.217",
1239
+ "anony": true,
1240
+ "tstamp": 1715719397.7162
1241
+ },
1242
+ {
1243
+ "model_a": "PNP",
1244
+ "model_b": "InstructPix2Pix",
1245
+ "winner": "tie (bothbad)",
1246
+ "judge": "arena_user_10.16.2.201",
1247
+ "anony": true,
1248
+ "tstamp": 1715719406.4165
1249
+ },
1250
+ {
1251
+ "model_a": "Pix2PixZero",
1252
+ "model_b": "PNP",
1253
+ "winner": "model_b",
1254
+ "judge": "arena_user_10.16.25.191",
1255
+ "anony": true,
1256
+ "tstamp": 1715719429.1002
1257
+ },
1258
+ {
1259
+ "model_a": "CosXLEdit",
1260
+ "model_b": "MagicBrush",
1261
+ "winner": "model_a",
1262
+ "judge": "arena_user_10.16.2.201",
1263
+ "anony": true,
1264
+ "tstamp": 1715719435.4694
1265
+ },
1266
+ {
1267
+ "model_a": "PNP",
1268
+ "model_b": "SDEdit",
1269
+ "winner": "tie (bothbad)",
1270
+ "judge": "arena_user_10.16.2.201",
1271
+ "anony": true,
1272
+ "tstamp": 1715719454.4526
1273
+ },
1274
+ {
1275
+ "model_a": "InfEdit",
1276
+ "model_b": "PNP",
1277
+ "winner": "tie (bothbad)",
1278
+ "judge": "arena_user_10.16.17.217",
1279
+ "anony": true,
1280
+ "tstamp": 1715719470.154
1281
+ },
1282
+ {
1283
+ "model_a": "MagicBrush",
1284
+ "model_b": "PNP",
1285
+ "winner": "model_a",
1286
+ "judge": "arena_user_10.16.41.118",
1287
+ "anony": true,
1288
+ "tstamp": 1715719482.3114
1289
+ },
1290
+ {
1291
+ "model_a": "SDEdit",
1292
+ "model_b": "PNP",
1293
+ "winner": "tie",
1294
+ "judge": "arena_user_10.16.2.201",
1295
+ "anony": true,
1296
+ "tstamp": 1715719499.9643
1297
+ },
1298
+ {
1299
+ "model_a": "InstructPix2Pix",
1300
+ "model_b": "MagicBrush",
1301
+ "winner": "model_b",
1302
+ "judge": "arena_user_10.16.2.201",
1303
+ "anony": true,
1304
+ "tstamp": 1715719513.7317
1305
+ },
1306
+ {
1307
+ "model_a": "InfEdit",
1308
+ "model_b": "PNP",
1309
+ "winner": "model_a",
1310
+ "judge": "arena_user_10.16.15.199",
1311
+ "anony": true,
1312
+ "tstamp": 1715719527.69
1313
+ },
1314
+ {
1315
+ "model_a": "Prompt2prompt",
1316
+ "model_b": "MagicBrush",
1317
+ "winner": "tie (bothbad)",
1318
+ "judge": "arena_user_10.16.41.118",
1319
+ "anony": true,
1320
+ "tstamp": 1715719542.751
1321
+ },
1322
+ {
1323
+ "model_a": "Pix2PixZero",
1324
+ "model_b": "InfEdit",
1325
+ "winner": "tie (bothbad)",
1326
+ "judge": "arena_user_10.16.15.199",
1327
+ "anony": true,
1328
+ "tstamp": 1715719560.9912
1329
+ },
1330
+ {
1331
+ "model_a": "PNP",
1332
+ "model_b": "Pix2PixZero",
1333
+ "winner": "tie (bothbad)",
1334
+ "judge": "arena_user_10.16.2.201",
1335
+ "anony": true,
1336
+ "tstamp": 1715719575.3291
1337
+ },
1338
+ {
1339
+ "model_a": "PNP",
1340
+ "model_b": "CosXLEdit",
1341
+ "winner": "model_b",
1342
+ "judge": "arena_user_10.16.17.217",
1343
+ "anony": true,
1344
+ "tstamp": 1715719581.9552
1345
+ },
1346
+ {
1347
+ "model_a": "Pix2PixZero",
1348
+ "model_b": "Prompt2prompt",
1349
+ "winner": "tie (bothbad)",
1350
+ "judge": "arena_user_10.16.25.191",
1351
+ "anony": true,
1352
+ "tstamp": 1715719591.9907
1353
+ },
1354
+ {
1355
+ "model_a": "CosXLEdit",
1356
+ "model_b": "SDEdit",
1357
+ "winner": "model_a",
1358
+ "judge": "arena_user_10.16.2.201",
1359
+ "anony": true,
1360
+ "tstamp": 1715719601.8819
1361
+ },
1362
+ {
1363
+ "model_a": "InfEdit",
1364
+ "model_b": "MagicBrush",
1365
+ "winner": "model_b",
1366
+ "judge": "arena_user_10.16.41.118",
1367
+ "anony": true,
1368
+ "tstamp": 1715719612.1837
1369
+ },
1370
+ {
1371
+ "model_a": "SDEdit",
1372
+ "model_b": "InstructPix2Pix",
1373
+ "winner": "tie (bothbad)",
1374
+ "judge": "arena_user_10.16.2.201",
1375
+ "anony": true,
1376
+ "tstamp": 1715719620.469
1377
+ },
1378
+ {
1379
+ "model_a": "InstructPix2Pix",
1380
+ "model_b": "MagicBrush",
1381
+ "winner": "tie (bothbad)",
1382
+ "judge": "arena_user_10.16.41.118",
1383
+ "anony": true,
1384
+ "tstamp": 1715719627.34
1385
+ },
1386
+ {
1387
+ "model_a": "MagicBrush",
1388
+ "model_b": "Prompt2prompt",
1389
+ "winner": "model_a",
1390
+ "judge": "arena_user_10.16.2.201",
1391
+ "anony": true,
1392
+ "tstamp": 1715719632.694
1393
+ },
1394
+ {
1395
+ "model_a": "Prompt2prompt",
1396
+ "model_b": "SDEdit",
1397
+ "winner": "tie (bothbad)",
1398
+ "judge": "arena_user_10.16.41.118",
1399
+ "anony": true,
1400
+ "tstamp": 1715719652.2038
1401
+ },
1402
+ {
1403
+ "model_a": "SDEdit",
1404
+ "model_b": "Prompt2prompt",
1405
+ "winner": "tie (bothbad)",
1406
+ "judge": "arena_user_10.16.25.191",
1407
+ "anony": true,
1408
+ "tstamp": 1715719661.8855
1409
+ },
1410
+ {
1411
+ "model_a": "CosXLEdit",
1412
+ "model_b": "Prompt2prompt",
1413
+ "winner": "tie (bothbad)",
1414
+ "judge": "arena_user_10.16.2.201",
1415
+ "anony": true,
1416
+ "tstamp": 1715719677.2949
1417
+ },
1418
+ {
1419
+ "model_a": "MagicBrush",
1420
+ "model_b": "Prompt2prompt",
1421
+ "winner": "model_a",
1422
+ "judge": "arena_user_10.16.2.201",
1423
+ "anony": true,
1424
+ "tstamp": 1715719687.3022
1425
+ },
1426
+ {
1427
+ "model_a": "SDEdit",
1428
+ "model_b": "Prompt2prompt",
1429
+ "winner": "model_b",
1430
+ "judge": "arena_user_10.16.2.201",
1431
+ "anony": true,
1432
+ "tstamp": 1715719699.47
1433
+ },
1434
+ {
1435
+ "model_a": "Pix2PixZero",
1436
+ "model_b": "InfEdit",
1437
+ "winner": "model_b",
1438
+ "judge": "arena_user_10.16.2.201",
1439
+ "anony": true,
1440
+ "tstamp": 1715719706.2375
1441
+ },
1442
+ {
1443
+ "model_a": "CosXLEdit",
1444
+ "model_b": "Prompt2prompt",
1445
+ "winner": "model_a",
1446
+ "judge": "arena_user_10.16.17.217",
1447
+ "anony": true,
1448
+ "tstamp": 1715719717.3564
1449
+ },
1450
+ {
1451
+ "model_a": "InstructPix2Pix",
1452
+ "model_b": "CosXLEdit",
1453
+ "winner": "tie (bothbad)",
1454
+ "judge": "arena_user_10.16.25.191",
1455
+ "anony": true,
1456
+ "tstamp": 1715719722.5542
1457
+ },
1458
+ {
1459
+ "model_a": "InfEdit",
1460
+ "model_b": "InstructPix2Pix",
1461
+ "winner": "tie (bothbad)",
1462
+ "judge": "arena_user_10.16.41.118",
1463
+ "anony": true,
1464
+ "tstamp": 1715719728.5417
1465
+ },
1466
+ {
1467
+ "model_a": "MagicBrush",
1468
+ "model_b": "SDEdit",
1469
+ "winner": "model_a",
1470
+ "judge": "arena_user_10.16.2.201",
1471
+ "anony": true,
1472
+ "tstamp": 1715719737.2385
1473
+ },
1474
+ {
1475
+ "model_a": "MagicBrush",
1476
+ "model_b": "Pix2PixZero",
1477
+ "winner": "tie (bothbad)",
1478
+ "judge": "arena_user_10.16.15.199",
1479
+ "anony": true,
1480
+ "tstamp": 1715815138.5243
1481
+ },
1482
+ {
1483
+ "model_a": "CosXLEdit",
1484
+ "model_b": "Prompt2prompt",
1485
+ "winner": "model_b",
1486
+ "judge": "arena_user_10.16.17.217",
1487
+ "anony": true,
1488
+ "tstamp": 1715815152.0033
1489
+ },
1490
+ {
1491
+ "model_a": "Pix2PixZero",
1492
+ "model_b": "Prompt2prompt",
1493
+ "winner": "tie (bothbad)",
1494
+ "judge": "arena_user_10.16.41.118",
1495
+ "anony": true,
1496
+ "tstamp": 1715815169.0475
1497
+ },
1498
+ {
1499
+ "model_a": "InstructPix2Pix",
1500
+ "model_b": "SDEdit",
1501
+ "winner": "model_b",
1502
+ "judge": "arena_user_10.16.41.118",
1503
+ "anony": true,
1504
+ "tstamp": 1715815187.1917
1505
+ },
1506
+ {
1507
+ "model_a": "InstructPix2Pix",
1508
+ "model_b": "Pix2PixZero",
1509
+ "winner": "tie (bothbad)",
1510
+ "judge": "arena_user_10.16.2.201",
1511
+ "anony": true,
1512
+ "tstamp": 1715815197.5233
1513
+ },
1514
+ {
1515
+ "model_a": "Pix2PixZero",
1516
+ "model_b": "SDEdit",
1517
+ "winner": "tie (bothbad)",
1518
+ "judge": "arena_user_10.16.2.201",
1519
+ "anony": true,
1520
+ "tstamp": 1715815209.8285
1521
+ },
1522
+ {
1523
+ "model_a": "CycleDiffusion",
1524
+ "model_b": "MagicBrush",
1525
+ "winner": "model_b",
1526
+ "judge": "arena_user_10.16.2.201",
1527
+ "anony": true,
1528
+ "tstamp": 1715815228.6736
1529
+ },
1530
+ {
1531
+ "model_a": "InfEdit",
1532
+ "model_b": "Pix2PixZero",
1533
+ "winner": "tie (bothbad)",
1534
+ "judge": "arena_user_10.16.2.201",
1535
+ "anony": true,
1536
+ "tstamp": 1715815236.3935
1537
+ },
1538
+ {
1539
+ "model_a": "SDEdit",
1540
+ "model_b": "PNP",
1541
+ "winner": "tie (bothbad)",
1542
+ "judge": "arena_user_10.16.25.191",
1543
+ "anony": true,
1544
+ "tstamp": 1715815265.9705
1545
+ },
1546
+ {
1547
+ "model_a": "MagicBrush",
1548
+ "model_b": "SDEdit",
1549
+ "winner": "tie (bothbad)",
1550
+ "judge": "arena_user_10.16.15.199",
1551
+ "anony": true,
1552
+ "tstamp": 1715815278.5019
1553
+ },
1554
+ {
1555
+ "model_a": "CycleDiffusion",
1556
+ "model_b": "CosXLEdit",
1557
+ "winner": "tie (bothbad)",
1558
+ "judge": "arena_user_10.16.15.199",
1559
+ "anony": true,
1560
+ "tstamp": 1715815294.5978
1561
+ },
1562
+ {
1563
+ "model_a": "MagicBrush",
1564
+ "model_b": "InfEdit",
1565
+ "winner": "model_a",
1566
+ "judge": "arena_user_10.16.17.217",
1567
+ "anony": true,
1568
+ "tstamp": 1715815325.4468
1569
+ },
1570
+ {
1571
+ "model_a": "MagicBrush",
1572
+ "model_b": "Pix2PixZero",
1573
+ "winner": "model_a",
1574
+ "judge": "arena_user_10.16.41.118",
1575
+ "anony": true,
1576
+ "tstamp": 1715913098.6617
1577
+ }
1578
+ ]
arena_elo/results/20240516/elo_results_image_editing.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:837f11fd6cda1fe2d6a5cc1c239a207725ad0157b16282303cb684427ddc7e9d
3
+ size 62484
arena_elo/results/20240516/image_editing_leaderboard.csv ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ CosXLEdit,CosXLEdit,1097.63559213644,1085.7285800995926,cosxl-nc-community,Stability AI,https://huggingface.co/spaces/multimodalart/cosxl
3
+ MagicBrush,MagicBrush,1075.1489922450316,1086.8819832924794,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
4
+ InfEdit,InfEdit,1065.4719519196174,1090.684638162955,Apache-2.0,"University of Michigan, University of California, Berkeley",https://huggingface.co/spaces/sled-umich/InfEdit
5
+ Prompt2prompt,Prompt2prompt,1063.1432047252297,1060.8146250689238,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
6
+ InstructPix2Pix,InstructPix2Pix,1043.9312648233226,1028.7932718869638,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
7
+ PNP,PNP,1022.4342554377677,1043.322342347598,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
8
+ Pix2PixZero,Pix2PixZero,891.2979039265506,886.7359371585381,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io
9
+ SDEdit,SDEdit,890.443823405714,880.5508125882768,MIT License,Stanford University,https://sde-image-editing.github.io
10
+ CycleDiffusion,CycleDiffusion,850.4930113803264,836.4878093946726,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
arena_elo/results/20240517/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240517/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93808a9ce2f497109d0fc708e4055b6463a692502ef541ff28352f52b612916d
3
+ size 68172
arena_elo/results/20240517/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1136.9514432133128,1081.5838551712898,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ PlayGround V2,PlayGround V2,1099.4286233187172,1042.590911846903,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
4
+ SDXLLightning,SDXLLightning,1062.4565867132737,1004.4096880141087,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
5
+ StableCascade,StableCascade,1061.93020315328,1006.1117357811837,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
6
+ PixArtAlpha,PixArtAlpha,1051.847602698194,981.1247821885942,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
7
+ PixArtSigma,PixArtSigma,1049.8339911951734,989.7640320919886,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
8
+ SDXL,SDXL,999.6167439144875,941.9623909945509,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
9
+ SDXLTurbo,SDXLTurbo,933.468824554199,875.8124778188443,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
10
+ LCM(v1.5/XL),LCM(v1.5/XL),929.425577747465,865.7356218313212,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
11
+ OpenJourney,OpenJourney,857.2709081764949,793.4952273226107,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
12
+ LCM,LCM,817.7694953154022,773.4948395309905,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -806,5 +806,773 @@
806
  "judge": "arena_user_10.16.25.191",
807
  "anony": true,
808
  "tstamp": 1714363016.9972
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
809
  }
810
  ]
 
806
  "judge": "arena_user_10.16.25.191",
807
  "anony": true,
808
  "tstamp": 1714363016.9972
809
+ },
810
+ {
811
+ "model_a": "InfEdit",
812
+ "model_b": "CosXLEdit",
813
+ "winner": "model_a",
814
+ "judge": "arena_user_10.16.25.191",
815
+ "anony": true,
816
+ "tstamp": 1714715956.3416
817
+ },
818
+ {
819
+ "model_a": "Pix2PixZero",
820
+ "model_b": "Prompt2prompt",
821
+ "winner": "tie (bothbad)",
822
+ "judge": "arena_user_10.16.2.201",
823
+ "anony": false,
824
+ "tstamp": 1714759928.3804
825
+ },
826
+ {
827
+ "model_a": "PNP",
828
+ "model_b": "InstructPix2Pix",
829
+ "winner": "model_a",
830
+ "judge": "arena_user_10.16.17.217",
831
+ "anony": true,
832
+ "tstamp": 1715246275.0118
833
+ },
834
+ {
835
+ "model_a": "SDEdit",
836
+ "model_b": "CosXLEdit",
837
+ "winner": "tie (bothbad)",
838
+ "judge": "arena_user_10.16.15.199",
839
+ "anony": true,
840
+ "tstamp": 1715247590.2235
841
+ },
842
+ {
843
+ "model_a": "CycleDiffusion",
844
+ "model_b": "CosXLEdit",
845
+ "winner": "model_b",
846
+ "judge": "arena_user_10.16.41.118",
847
+ "anony": false,
848
+ "tstamp": 1715406266.2562
849
+ },
850
+ {
851
+ "model_a": "CycleDiffusion",
852
+ "model_b": "CosXLEdit",
853
+ "winner": "model_a",
854
+ "judge": "arena_user_10.16.41.118",
855
+ "anony": false,
856
+ "tstamp": 1715406354.5284
857
+ },
858
+ {
859
+ "model_a": "CycleDiffusion",
860
+ "model_b": "CosXLEdit",
861
+ "winner": "model_b",
862
+ "judge": "arena_user_10.16.2.201",
863
+ "anony": false,
864
+ "tstamp": 1715406371.8227
865
+ },
866
+ {
867
+ "model_a": "CycleDiffusion",
868
+ "model_b": "CosXLEdit",
869
+ "winner": "model_b",
870
+ "judge": "arena_user_10.16.41.118",
871
+ "anony": false,
872
+ "tstamp": 1715406418.5066
873
+ },
874
+ {
875
+ "model_a": "CycleDiffusion",
876
+ "model_b": "CosXLEdit",
877
+ "winner": "model_b",
878
+ "judge": "arena_user_10.16.25.191",
879
+ "anony": false,
880
+ "tstamp": 1715406449.9401
881
+ },
882
+ {
883
+ "model_a": "CycleDiffusion",
884
+ "model_b": "CosXLEdit",
885
+ "winner": "model_b",
886
+ "judge": "arena_user_10.16.41.118",
887
+ "anony": false,
888
+ "tstamp": 1715406466.5778
889
+ },
890
+ {
891
+ "model_a": "InfEdit",
892
+ "model_b": "CycleDiffusion",
893
+ "winner": "model_a",
894
+ "judge": "arena_user_10.16.2.201",
895
+ "anony": true,
896
+ "tstamp": 1715620708.6361
897
+ },
898
+ {
899
+ "model_a": "Prompt2prompt",
900
+ "model_b": "CosXLEdit",
901
+ "winner": "model_a",
902
+ "judge": "arena_user_10.16.41.118",
903
+ "anony": false,
904
+ "tstamp": 1715621013.5373
905
+ },
906
+ {
907
+ "model_a": "MagicBrush",
908
+ "model_b": "CycleDiffusion",
909
+ "winner": "tie (bothbad)",
910
+ "judge": "arena_user_10.16.2.201",
911
+ "anony": true,
912
+ "tstamp": 1715661224.0507
913
+ },
914
+ {
915
+ "model_a": "SDEdit",
916
+ "model_b": "PNP",
917
+ "winner": "tie (bothbad)",
918
+ "judge": "arena_user_10.16.41.118",
919
+ "anony": true,
920
+ "tstamp": 1715661259.6143
921
+ },
922
+ {
923
+ "model_a": "Pix2PixZero",
924
+ "model_b": "Prompt2prompt",
925
+ "winner": "tie (bothbad)",
926
+ "judge": "arena_user_10.16.41.118",
927
+ "anony": true,
928
+ "tstamp": 1715661288.6018
929
+ },
930
+ {
931
+ "model_a": "InstructPix2Pix",
932
+ "model_b": "Prompt2prompt",
933
+ "winner": "model_b",
934
+ "judge": "arena_user_10.16.25.191",
935
+ "anony": true,
936
+ "tstamp": 1715661310.3621
937
+ },
938
+ {
939
+ "model_a": "CosXLEdit",
940
+ "model_b": "InstructPix2Pix",
941
+ "winner": "tie (bothbad)",
942
+ "judge": "arena_user_10.16.25.191",
943
+ "anony": true,
944
+ "tstamp": 1715718742.1258
945
+ },
946
+ {
947
+ "model_a": "MagicBrush",
948
+ "model_b": "PNP",
949
+ "winner": "model_a",
950
+ "judge": "arena_user_10.16.2.201",
951
+ "anony": true,
952
+ "tstamp": 1715718773.1054
953
+ },
954
+ {
955
+ "model_a": "SDEdit",
956
+ "model_b": "CosXLEdit",
957
+ "winner": "tie (bothbad)",
958
+ "judge": "arena_user_10.16.2.201",
959
+ "anony": true,
960
+ "tstamp": 1715718785.2832
961
+ },
962
+ {
963
+ "model_a": "InstructPix2Pix",
964
+ "model_b": "SDEdit",
965
+ "winner": "tie (bothbad)",
966
+ "judge": "arena_user_10.16.2.201",
967
+ "anony": true,
968
+ "tstamp": 1715718804.143
969
+ },
970
+ {
971
+ "model_a": "InfEdit",
972
+ "model_b": "CosXLEdit",
973
+ "winner": "model_b",
974
+ "judge": "arena_user_10.16.25.191",
975
+ "anony": true,
976
+ "tstamp": 1715718826.0248
977
+ },
978
+ {
979
+ "model_a": "InfEdit",
980
+ "model_b": "Prompt2prompt",
981
+ "winner": "model_a",
982
+ "judge": "arena_user_10.16.2.201",
983
+ "anony": true,
984
+ "tstamp": 1715718869.0041
985
+ },
986
+ {
987
+ "model_a": "InfEdit",
988
+ "model_b": "CosXLEdit",
989
+ "winner": "model_b",
990
+ "judge": "arena_user_10.16.2.201",
991
+ "anony": true,
992
+ "tstamp": 1715718904.9307
993
+ },
994
+ {
995
+ "model_a": "Prompt2prompt",
996
+ "model_b": "Pix2PixZero",
997
+ "winner": "model_a",
998
+ "judge": "arena_user_10.16.25.191",
999
+ "anony": true,
1000
+ "tstamp": 1715718933.1272
1001
+ },
1002
+ {
1003
+ "model_a": "Pix2PixZero",
1004
+ "model_b": "MagicBrush",
1005
+ "winner": "tie (bothbad)",
1006
+ "judge": "arena_user_10.16.2.201",
1007
+ "anony": true,
1008
+ "tstamp": 1715718954.8497
1009
+ },
1010
+ {
1011
+ "model_a": "MagicBrush",
1012
+ "model_b": "PNP",
1013
+ "winner": "model_b",
1014
+ "judge": "arena_user_10.16.25.191",
1015
+ "anony": true,
1016
+ "tstamp": 1715718966.8633
1017
+ },
1018
+ {
1019
+ "model_a": "CycleDiffusion",
1020
+ "model_b": "Prompt2prompt",
1021
+ "winner": "tie (bothbad)",
1022
+ "judge": "arena_user_10.16.25.191",
1023
+ "anony": true,
1024
+ "tstamp": 1715719000.6673
1025
+ },
1026
+ {
1027
+ "model_a": "MagicBrush",
1028
+ "model_b": "Pix2PixZero",
1029
+ "winner": "tie (bothbad)",
1030
+ "judge": "arena_user_10.16.25.191",
1031
+ "anony": true,
1032
+ "tstamp": 1715719019.5495
1033
+ },
1034
+ {
1035
+ "model_a": "InfEdit",
1036
+ "model_b": "Prompt2prompt",
1037
+ "winner": "model_a",
1038
+ "judge": "arena_user_10.16.25.191",
1039
+ "anony": true,
1040
+ "tstamp": 1715719035.903
1041
+ },
1042
+ {
1043
+ "model_a": "MagicBrush",
1044
+ "model_b": "Pix2PixZero",
1045
+ "winner": "model_a",
1046
+ "judge": "arena_user_10.16.25.191",
1047
+ "anony": true,
1048
+ "tstamp": 1715719046.925
1049
+ },
1050
+ {
1051
+ "model_a": "CycleDiffusion",
1052
+ "model_b": "CosXLEdit",
1053
+ "winner": "tie (bothbad)",
1054
+ "judge": "arena_user_10.16.2.201",
1055
+ "anony": true,
1056
+ "tstamp": 1715719059.6291
1057
+ },
1058
+ {
1059
+ "model_a": "Prompt2prompt",
1060
+ "model_b": "SDEdit",
1061
+ "winner": "tie (bothbad)",
1062
+ "judge": "arena_user_10.16.15.199",
1063
+ "anony": true,
1064
+ "tstamp": 1715719076.6727
1065
+ },
1066
+ {
1067
+ "model_a": "MagicBrush",
1068
+ "model_b": "PNP",
1069
+ "winner": "model_a",
1070
+ "judge": "arena_user_10.16.25.191",
1071
+ "anony": true,
1072
+ "tstamp": 1715719086.7836
1073
+ },
1074
+ {
1075
+ "model_a": "CycleDiffusion",
1076
+ "model_b": "MagicBrush",
1077
+ "winner": "model_b",
1078
+ "judge": "arena_user_10.16.25.191",
1079
+ "anony": true,
1080
+ "tstamp": 1715719109.8071
1081
+ },
1082
+ {
1083
+ "model_a": "Prompt2prompt",
1084
+ "model_b": "InstructPix2Pix",
1085
+ "winner": "model_b",
1086
+ "judge": "arena_user_10.16.25.191",
1087
+ "anony": true,
1088
+ "tstamp": 1715719122.8237
1089
+ },
1090
+ {
1091
+ "model_a": "MagicBrush",
1092
+ "model_b": "SDEdit",
1093
+ "winner": "model_a",
1094
+ "judge": "arena_user_10.16.15.199",
1095
+ "anony": true,
1096
+ "tstamp": 1715719134.1345
1097
+ },
1098
+ {
1099
+ "model_a": "SDEdit",
1100
+ "model_b": "CycleDiffusion",
1101
+ "winner": "tie (bothbad)",
1102
+ "judge": "arena_user_10.16.17.217",
1103
+ "anony": true,
1104
+ "tstamp": 1715719153.4359
1105
+ },
1106
+ {
1107
+ "model_a": "Pix2PixZero",
1108
+ "model_b": "MagicBrush",
1109
+ "winner": "tie (bothbad)",
1110
+ "judge": "arena_user_10.16.17.217",
1111
+ "anony": true,
1112
+ "tstamp": 1715719160.5285
1113
+ },
1114
+ {
1115
+ "model_a": "MagicBrush",
1116
+ "model_b": "InstructPix2Pix",
1117
+ "winner": "model_b",
1118
+ "judge": "arena_user_10.16.15.199",
1119
+ "anony": true,
1120
+ "tstamp": 1715719171.4473
1121
+ },
1122
+ {
1123
+ "model_a": "InstructPix2Pix",
1124
+ "model_b": "SDEdit",
1125
+ "winner": "tie (bothbad)",
1126
+ "judge": "arena_user_10.16.2.201",
1127
+ "anony": true,
1128
+ "tstamp": 1715719184.6227
1129
+ },
1130
+ {
1131
+ "model_a": "CosXLEdit",
1132
+ "model_b": "MagicBrush",
1133
+ "winner": "model_a",
1134
+ "judge": "arena_user_10.16.2.201",
1135
+ "anony": true,
1136
+ "tstamp": 1715719210.0429
1137
+ },
1138
+ {
1139
+ "model_a": "CycleDiffusion",
1140
+ "model_b": "MagicBrush",
1141
+ "winner": "model_b",
1142
+ "judge": "arena_user_10.16.41.118",
1143
+ "anony": true,
1144
+ "tstamp": 1715719219.6447
1145
+ },
1146
+ {
1147
+ "model_a": "PNP",
1148
+ "model_b": "Pix2PixZero",
1149
+ "winner": "tie (bothbad)",
1150
+ "judge": "arena_user_10.16.41.118",
1151
+ "anony": true,
1152
+ "tstamp": 1715719237.7036
1153
+ },
1154
+ {
1155
+ "model_a": "PNP",
1156
+ "model_b": "CycleDiffusion",
1157
+ "winner": "tie (bothbad)",
1158
+ "judge": "arena_user_10.16.25.191",
1159
+ "anony": true,
1160
+ "tstamp": 1715719249.4321
1161
+ },
1162
+ {
1163
+ "model_a": "Prompt2prompt",
1164
+ "model_b": "Pix2PixZero",
1165
+ "winner": "model_a",
1166
+ "judge": "arena_user_10.16.2.201",
1167
+ "anony": true,
1168
+ "tstamp": 1715719257.5877
1169
+ },
1170
+ {
1171
+ "model_a": "CosXLEdit",
1172
+ "model_b": "Pix2PixZero",
1173
+ "winner": "tie (bothbad)",
1174
+ "judge": "arena_user_10.16.25.191",
1175
+ "anony": true,
1176
+ "tstamp": 1715719273.7637
1177
+ },
1178
+ {
1179
+ "model_a": "PNP",
1180
+ "model_b": "CosXLEdit",
1181
+ "winner": "model_b",
1182
+ "judge": "arena_user_10.16.17.217",
1183
+ "anony": true,
1184
+ "tstamp": 1715719288.4629
1185
+ },
1186
+ {
1187
+ "model_a": "Pix2PixZero",
1188
+ "model_b": "PNP",
1189
+ "winner": "model_b",
1190
+ "judge": "arena_user_10.16.41.118",
1191
+ "anony": true,
1192
+ "tstamp": 1715719299.1712
1193
+ },
1194
+ {
1195
+ "model_a": "PNP",
1196
+ "model_b": "MagicBrush",
1197
+ "winner": "model_b",
1198
+ "judge": "arena_user_10.16.2.201",
1199
+ "anony": true,
1200
+ "tstamp": 1715719306.5928
1201
+ },
1202
+ {
1203
+ "model_a": "InstructPix2Pix",
1204
+ "model_b": "PNP",
1205
+ "winner": "tie (bothbad)",
1206
+ "judge": "arena_user_10.16.15.199",
1207
+ "anony": true,
1208
+ "tstamp": 1715719356.0694
1209
+ },
1210
+ {
1211
+ "model_a": "Prompt2prompt",
1212
+ "model_b": "CosXLEdit",
1213
+ "winner": "model_a",
1214
+ "judge": "arena_user_10.16.25.191",
1215
+ "anony": true,
1216
+ "tstamp": 1715719368.0491
1217
+ },
1218
+ {
1219
+ "model_a": "Prompt2prompt",
1220
+ "model_b": "CycleDiffusion",
1221
+ "winner": "tie (bothbad)",
1222
+ "judge": "arena_user_10.16.41.118",
1223
+ "anony": true,
1224
+ "tstamp": 1715719379.185
1225
+ },
1226
+ {
1227
+ "model_a": "CycleDiffusion",
1228
+ "model_b": "Prompt2prompt",
1229
+ "winner": "tie (bothbad)",
1230
+ "judge": "arena_user_10.16.2.201",
1231
+ "anony": true,
1232
+ "tstamp": 1715719389.0771
1233
+ },
1234
+ {
1235
+ "model_a": "Pix2PixZero",
1236
+ "model_b": "MagicBrush",
1237
+ "winner": "model_b",
1238
+ "judge": "arena_user_10.16.17.217",
1239
+ "anony": true,
1240
+ "tstamp": 1715719397.7162
1241
+ },
1242
+ {
1243
+ "model_a": "PNP",
1244
+ "model_b": "InstructPix2Pix",
1245
+ "winner": "tie (bothbad)",
1246
+ "judge": "arena_user_10.16.2.201",
1247
+ "anony": true,
1248
+ "tstamp": 1715719406.4165
1249
+ },
1250
+ {
1251
+ "model_a": "Pix2PixZero",
1252
+ "model_b": "PNP",
1253
+ "winner": "model_b",
1254
+ "judge": "arena_user_10.16.25.191",
1255
+ "anony": true,
1256
+ "tstamp": 1715719429.1002
1257
+ },
1258
+ {
1259
+ "model_a": "CosXLEdit",
1260
+ "model_b": "MagicBrush",
1261
+ "winner": "model_a",
1262
+ "judge": "arena_user_10.16.2.201",
1263
+ "anony": true,
1264
+ "tstamp": 1715719435.4694
1265
+ },
1266
+ {
1267
+ "model_a": "PNP",
1268
+ "model_b": "SDEdit",
1269
+ "winner": "tie (bothbad)",
1270
+ "judge": "arena_user_10.16.2.201",
1271
+ "anony": true,
1272
+ "tstamp": 1715719454.4526
1273
+ },
1274
+ {
1275
+ "model_a": "InfEdit",
1276
+ "model_b": "PNP",
1277
+ "winner": "tie (bothbad)",
1278
+ "judge": "arena_user_10.16.17.217",
1279
+ "anony": true,
1280
+ "tstamp": 1715719470.154
1281
+ },
1282
+ {
1283
+ "model_a": "MagicBrush",
1284
+ "model_b": "PNP",
1285
+ "winner": "model_a",
1286
+ "judge": "arena_user_10.16.41.118",
1287
+ "anony": true,
1288
+ "tstamp": 1715719482.3114
1289
+ },
1290
+ {
1291
+ "model_a": "SDEdit",
1292
+ "model_b": "PNP",
1293
+ "winner": "tie",
1294
+ "judge": "arena_user_10.16.2.201",
1295
+ "anony": true,
1296
+ "tstamp": 1715719499.9643
1297
+ },
1298
+ {
1299
+ "model_a": "InstructPix2Pix",
1300
+ "model_b": "MagicBrush",
1301
+ "winner": "model_b",
1302
+ "judge": "arena_user_10.16.2.201",
1303
+ "anony": true,
1304
+ "tstamp": 1715719513.7317
1305
+ },
1306
+ {
1307
+ "model_a": "InfEdit",
1308
+ "model_b": "PNP",
1309
+ "winner": "model_a",
1310
+ "judge": "arena_user_10.16.15.199",
1311
+ "anony": true,
1312
+ "tstamp": 1715719527.69
1313
+ },
1314
+ {
1315
+ "model_a": "Prompt2prompt",
1316
+ "model_b": "MagicBrush",
1317
+ "winner": "tie (bothbad)",
1318
+ "judge": "arena_user_10.16.41.118",
1319
+ "anony": true,
1320
+ "tstamp": 1715719542.751
1321
+ },
1322
+ {
1323
+ "model_a": "Pix2PixZero",
1324
+ "model_b": "InfEdit",
1325
+ "winner": "tie (bothbad)",
1326
+ "judge": "arena_user_10.16.15.199",
1327
+ "anony": true,
1328
+ "tstamp": 1715719560.9912
1329
+ },
1330
+ {
1331
+ "model_a": "PNP",
1332
+ "model_b": "Pix2PixZero",
1333
+ "winner": "tie (bothbad)",
1334
+ "judge": "arena_user_10.16.2.201",
1335
+ "anony": true,
1336
+ "tstamp": 1715719575.3291
1337
+ },
1338
+ {
1339
+ "model_a": "PNP",
1340
+ "model_b": "CosXLEdit",
1341
+ "winner": "model_b",
1342
+ "judge": "arena_user_10.16.17.217",
1343
+ "anony": true,
1344
+ "tstamp": 1715719581.9552
1345
+ },
1346
+ {
1347
+ "model_a": "Pix2PixZero",
1348
+ "model_b": "Prompt2prompt",
1349
+ "winner": "tie (bothbad)",
1350
+ "judge": "arena_user_10.16.25.191",
1351
+ "anony": true,
1352
+ "tstamp": 1715719591.9907
1353
+ },
1354
+ {
1355
+ "model_a": "CosXLEdit",
1356
+ "model_b": "SDEdit",
1357
+ "winner": "model_a",
1358
+ "judge": "arena_user_10.16.2.201",
1359
+ "anony": true,
1360
+ "tstamp": 1715719601.8819
1361
+ },
1362
+ {
1363
+ "model_a": "InfEdit",
1364
+ "model_b": "MagicBrush",
1365
+ "winner": "model_b",
1366
+ "judge": "arena_user_10.16.41.118",
1367
+ "anony": true,
1368
+ "tstamp": 1715719612.1837
1369
+ },
1370
+ {
1371
+ "model_a": "SDEdit",
1372
+ "model_b": "InstructPix2Pix",
1373
+ "winner": "tie (bothbad)",
1374
+ "judge": "arena_user_10.16.2.201",
1375
+ "anony": true,
1376
+ "tstamp": 1715719620.469
1377
+ },
1378
+ {
1379
+ "model_a": "InstructPix2Pix",
1380
+ "model_b": "MagicBrush",
1381
+ "winner": "tie (bothbad)",
1382
+ "judge": "arena_user_10.16.41.118",
1383
+ "anony": true,
1384
+ "tstamp": 1715719627.34
1385
+ },
1386
+ {
1387
+ "model_a": "MagicBrush",
1388
+ "model_b": "Prompt2prompt",
1389
+ "winner": "model_a",
1390
+ "judge": "arena_user_10.16.2.201",
1391
+ "anony": true,
1392
+ "tstamp": 1715719632.694
1393
+ },
1394
+ {
1395
+ "model_a": "Prompt2prompt",
1396
+ "model_b": "SDEdit",
1397
+ "winner": "tie (bothbad)",
1398
+ "judge": "arena_user_10.16.41.118",
1399
+ "anony": true,
1400
+ "tstamp": 1715719652.2038
1401
+ },
1402
+ {
1403
+ "model_a": "SDEdit",
1404
+ "model_b": "Prompt2prompt",
1405
+ "winner": "tie (bothbad)",
1406
+ "judge": "arena_user_10.16.25.191",
1407
+ "anony": true,
1408
+ "tstamp": 1715719661.8855
1409
+ },
1410
+ {
1411
+ "model_a": "CosXLEdit",
1412
+ "model_b": "Prompt2prompt",
1413
+ "winner": "tie (bothbad)",
1414
+ "judge": "arena_user_10.16.2.201",
1415
+ "anony": true,
1416
+ "tstamp": 1715719677.2949
1417
+ },
1418
+ {
1419
+ "model_a": "MagicBrush",
1420
+ "model_b": "Prompt2prompt",
1421
+ "winner": "model_a",
1422
+ "judge": "arena_user_10.16.2.201",
1423
+ "anony": true,
1424
+ "tstamp": 1715719687.3022
1425
+ },
1426
+ {
1427
+ "model_a": "SDEdit",
1428
+ "model_b": "Prompt2prompt",
1429
+ "winner": "model_b",
1430
+ "judge": "arena_user_10.16.2.201",
1431
+ "anony": true,
1432
+ "tstamp": 1715719699.47
1433
+ },
1434
+ {
1435
+ "model_a": "Pix2PixZero",
1436
+ "model_b": "InfEdit",
1437
+ "winner": "model_b",
1438
+ "judge": "arena_user_10.16.2.201",
1439
+ "anony": true,
1440
+ "tstamp": 1715719706.2375
1441
+ },
1442
+ {
1443
+ "model_a": "CosXLEdit",
1444
+ "model_b": "Prompt2prompt",
1445
+ "winner": "model_a",
1446
+ "judge": "arena_user_10.16.17.217",
1447
+ "anony": true,
1448
+ "tstamp": 1715719717.3564
1449
+ },
1450
+ {
1451
+ "model_a": "InstructPix2Pix",
1452
+ "model_b": "CosXLEdit",
1453
+ "winner": "tie (bothbad)",
1454
+ "judge": "arena_user_10.16.25.191",
1455
+ "anony": true,
1456
+ "tstamp": 1715719722.5542
1457
+ },
1458
+ {
1459
+ "model_a": "InfEdit",
1460
+ "model_b": "InstructPix2Pix",
1461
+ "winner": "tie (bothbad)",
1462
+ "judge": "arena_user_10.16.41.118",
1463
+ "anony": true,
1464
+ "tstamp": 1715719728.5417
1465
+ },
1466
+ {
1467
+ "model_a": "MagicBrush",
1468
+ "model_b": "SDEdit",
1469
+ "winner": "model_a",
1470
+ "judge": "arena_user_10.16.2.201",
1471
+ "anony": true,
1472
+ "tstamp": 1715719737.2385
1473
+ },
1474
+ {
1475
+ "model_a": "MagicBrush",
1476
+ "model_b": "Pix2PixZero",
1477
+ "winner": "tie (bothbad)",
1478
+ "judge": "arena_user_10.16.15.199",
1479
+ "anony": true,
1480
+ "tstamp": 1715815138.5243
1481
+ },
1482
+ {
1483
+ "model_a": "CosXLEdit",
1484
+ "model_b": "Prompt2prompt",
1485
+ "winner": "model_b",
1486
+ "judge": "arena_user_10.16.17.217",
1487
+ "anony": true,
1488
+ "tstamp": 1715815152.0033
1489
+ },
1490
+ {
1491
+ "model_a": "Pix2PixZero",
1492
+ "model_b": "Prompt2prompt",
1493
+ "winner": "tie (bothbad)",
1494
+ "judge": "arena_user_10.16.41.118",
1495
+ "anony": true,
1496
+ "tstamp": 1715815169.0475
1497
+ },
1498
+ {
1499
+ "model_a": "InstructPix2Pix",
1500
+ "model_b": "SDEdit",
1501
+ "winner": "model_b",
1502
+ "judge": "arena_user_10.16.41.118",
1503
+ "anony": true,
1504
+ "tstamp": 1715815187.1917
1505
+ },
1506
+ {
1507
+ "model_a": "InstructPix2Pix",
1508
+ "model_b": "Pix2PixZero",
1509
+ "winner": "tie (bothbad)",
1510
+ "judge": "arena_user_10.16.2.201",
1511
+ "anony": true,
1512
+ "tstamp": 1715815197.5233
1513
+ },
1514
+ {
1515
+ "model_a": "Pix2PixZero",
1516
+ "model_b": "SDEdit",
1517
+ "winner": "tie (bothbad)",
1518
+ "judge": "arena_user_10.16.2.201",
1519
+ "anony": true,
1520
+ "tstamp": 1715815209.8285
1521
+ },
1522
+ {
1523
+ "model_a": "CycleDiffusion",
1524
+ "model_b": "MagicBrush",
1525
+ "winner": "model_b",
1526
+ "judge": "arena_user_10.16.2.201",
1527
+ "anony": true,
1528
+ "tstamp": 1715815228.6736
1529
+ },
1530
+ {
1531
+ "model_a": "InfEdit",
1532
+ "model_b": "Pix2PixZero",
1533
+ "winner": "tie (bothbad)",
1534
+ "judge": "arena_user_10.16.2.201",
1535
+ "anony": true,
1536
+ "tstamp": 1715815236.3935
1537
+ },
1538
+ {
1539
+ "model_a": "SDEdit",
1540
+ "model_b": "PNP",
1541
+ "winner": "tie (bothbad)",
1542
+ "judge": "arena_user_10.16.25.191",
1543
+ "anony": true,
1544
+ "tstamp": 1715815265.9705
1545
+ },
1546
+ {
1547
+ "model_a": "MagicBrush",
1548
+ "model_b": "SDEdit",
1549
+ "winner": "tie (bothbad)",
1550
+ "judge": "arena_user_10.16.15.199",
1551
+ "anony": true,
1552
+ "tstamp": 1715815278.5019
1553
+ },
1554
+ {
1555
+ "model_a": "CycleDiffusion",
1556
+ "model_b": "CosXLEdit",
1557
+ "winner": "tie (bothbad)",
1558
+ "judge": "arena_user_10.16.15.199",
1559
+ "anony": true,
1560
+ "tstamp": 1715815294.5978
1561
+ },
1562
+ {
1563
+ "model_a": "MagicBrush",
1564
+ "model_b": "InfEdit",
1565
+ "winner": "model_a",
1566
+ "judge": "arena_user_10.16.17.217",
1567
+ "anony": true,
1568
+ "tstamp": 1715815325.4468
1569
+ },
1570
+ {
1571
+ "model_a": "MagicBrush",
1572
+ "model_b": "Pix2PixZero",
1573
+ "winner": "model_a",
1574
+ "judge": "arena_user_10.16.41.118",
1575
+ "anony": true,
1576
+ "tstamp": 1715913098.6617
1577
  }
1578
  ]
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/latest/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c1b4f1daab3429c7656eb8b3b2128a127480fa8212b17a1a98207884d7ce7a9f
3
- size 58442
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:837f11fd6cda1fe2d6a5cc1c239a207725ad0157b16282303cb684427ddc7e9d
3
+ size 62484
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9b79d128ba01570bc59c5f48e1c0640f2541817ce1a77abb3e16131884288b1a
3
- size 65313
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93808a9ce2f497109d0fc708e4055b6463a692502ef541ff28352f52b612916d
3
+ size 68172
arena_elo/results/latest/image_editing_leaderboard.csv CHANGED
@@ -1,8 +1,10 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- Prompt2prompt,Prompt2prompt,1224.5951620965877,1133.887231157847,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
3
- InstructPix2Pix,InstructPix2Pix,1162.3591990023222,1059.7394666236296,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
4
- PNP,PNP,1142.872221219748,1117.461082043853,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
5
- MagicBrush,MagicBrush,1053.6353139288728,1055.6074426532264,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
6
- Pix2PixZero,Pix2PixZero,918.4266240422415,853.535635519584,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io
7
- CycleDiffusion,CycleDiffusion,865.2495984976465,775.6226309361784,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
8
- SDEdit,SDEdit,632.8618812125814,680.2047869803968,MIT License,Stanford University,https://sde-image-editing.github.io
 
 
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ CosXLEdit,CosXLEdit,1097.63559213644,1085.7285800995926,cosxl-nc-community,Stability AI,https://huggingface.co/spaces/multimodalart/cosxl
3
+ MagicBrush,MagicBrush,1075.1489922450316,1086.8819832924794,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
4
+ InfEdit,InfEdit,1065.4719519196174,1090.684638162955,Apache-2.0,"University of Michigan, University of California, Berkeley",https://huggingface.co/spaces/sled-umich/InfEdit
5
+ Prompt2prompt,Prompt2prompt,1063.1432047252297,1060.8146250689238,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
6
+ InstructPix2Pix,InstructPix2Pix,1043.9312648233226,1028.7932718869638,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
7
+ PNP,PNP,1022.4342554377677,1043.322342347598,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
8
+ Pix2PixZero,Pix2PixZero,891.2979039265506,886.7359371585381,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io
9
+ SDEdit,SDEdit,890.443823405714,880.5508125882768,MIT License,Stanford University,https://sde-image-editing.github.io
10
+ CycleDiffusion,CycleDiffusion,850.4930113803264,836.4878093946726,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,11 +1,12 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1157.785440865029,1197.7936802344343,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- StableCascade,StableCascade,1116.6696847615349,1116.9442071854512,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
4
- PlayGround V2,PlayGround V2,1110.1291971452683,1120.6591618464581,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
5
- PixArtAlpha,PixArtAlpha,1042.1316579959862,1040.3305680293547,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
6
- SDXLLightning,SDXLLightning,1036.0784815928241,1056.600050803737,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
7
- SDXL,SDXL,987.5686859787551,1003.0595102032345,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
8
- PixArtSigma,PixArtSigma,948.0067582557859,961.4040676622378,N/A,N/A,N/A
9
- SDXLTurbo,SDXLTurbo,931.094996526404,945.5610964234802,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
10
- OpenJourney,OpenJourney,855.7449360962327,860.1159058283633,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
11
- LCM,LCM,814.7901607821794,840.5627577743975,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1136.9514432133128,1081.5838551712898,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ PlayGround V2,PlayGround V2,1099.4286233187172,1042.590911846903,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
4
+ SDXLLightning,SDXLLightning,1062.4565867132737,1004.4096880141087,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
5
+ StableCascade,StableCascade,1061.93020315328,1006.1117357811837,stable-cascade-nc-community (other),Stability AI,https://huggingface.co/stabilityai/stable-cascade
6
+ PixArtAlpha,PixArtAlpha,1051.847602698194,981.1247821885942,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
7
+ PixArtSigma,PixArtSigma,1049.8339911951734,989.7640320919886,openrail++,PixArt-alpha,https://fal.ai/models/fal-ai/pixart-sigma
8
+ SDXL,SDXL,999.6167439144875,941.9623909945509,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
9
+ SDXLTurbo,SDXLTurbo,933.468824554199,875.8124778188443,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
10
+ LCM(v1.5/XL),LCM(v1.5/XL),929.425577747465,865.7356218313212,openrail++,Latent Consistency,https://fal.ai/models/fal-ai/fast-lcm-diffusion/api
11
+ OpenJourney,OpenJourney,857.2709081764949,793.4952273226107,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
12
+ LCM,LCM,817.7694953154022,773.4948395309905,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7