DongfuJiang commited on
Commit
d750abb
1 Parent(s): dc40458
arena_elo/results/20240411/clean_battle_image_editing.json ADDED
@@ -0,0 +1,898 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "model_a": "CycleDiffusion",
4
+ "model_b": "InstructPix2Pix",
5
+ "winner": "model_b",
6
+ "judge": "arena_user_::1",
7
+ "anony": true,
8
+ "tstamp": 1707712630.872
9
+ },
10
+ {
11
+ "model_a": "CycleDiffusion",
12
+ "model_b": "InstructPix2Pix",
13
+ "winner": "model_b",
14
+ "judge": "arena_user_::1",
15
+ "anony": false,
16
+ "tstamp": 1707712699.668
17
+ },
18
+ {
19
+ "model_a": "Pix2PixZero",
20
+ "model_b": "MagicBrush",
21
+ "winner": "model_a",
22
+ "judge": "arena_user_::1",
23
+ "anony": true,
24
+ "tstamp": 1707712896.0427
25
+ },
26
+ {
27
+ "model_a": "CycleDiffusion",
28
+ "model_b": "InstructPix2Pix",
29
+ "winner": "model_b",
30
+ "judge": "arena_user_::1",
31
+ "anony": false,
32
+ "tstamp": 1707712929.7061
33
+ },
34
+ {
35
+ "model_a": "CycleDiffusion",
36
+ "model_b": "InstructPix2Pix",
37
+ "winner": "model_b",
38
+ "judge": "arena_user_::1",
39
+ "anony": true,
40
+ "tstamp": 1707713147.0445
41
+ },
42
+ {
43
+ "model_a": "CycleDiffusion",
44
+ "model_b": "PNP",
45
+ "winner": "model_b",
46
+ "judge": "arena_user_::1",
47
+ "anony": true,
48
+ "tstamp": 1707713198.9284
49
+ },
50
+ {
51
+ "model_a": "CycleDiffusion",
52
+ "model_b": "Prompt2prompt",
53
+ "winner": "model_b",
54
+ "judge": "arena_user_::1",
55
+ "anony": true,
56
+ "tstamp": 1707713210.1306
57
+ },
58
+ {
59
+ "model_a": "Prompt2prompt",
60
+ "model_b": "SDEdit",
61
+ "winner": "model_a",
62
+ "judge": "arena_user_::1",
63
+ "anony": true,
64
+ "tstamp": 1707713747.5115
65
+ },
66
+ {
67
+ "model_a": "PNP",
68
+ "model_b": "Pix2PixZero",
69
+ "winner": "model_a",
70
+ "judge": "arena_user_::1",
71
+ "anony": true,
72
+ "tstamp": 1707715613.7226
73
+ },
74
+ {
75
+ "model_a": "CycleDiffusion",
76
+ "model_b": "MagicBrush",
77
+ "winner": "model_b",
78
+ "judge": "arena_user_::1",
79
+ "anony": true,
80
+ "tstamp": 1707765708.2644
81
+ },
82
+ {
83
+ "model_a": "PNP",
84
+ "model_b": "CycleDiffusion",
85
+ "winner": "model_a",
86
+ "judge": "arena_user_::1",
87
+ "anony": true,
88
+ "tstamp": 1707765861.2742
89
+ },
90
+ {
91
+ "model_a": "PNP",
92
+ "model_b": "CycleDiffusion",
93
+ "winner": "model_a",
94
+ "judge": "arena_user_::1",
95
+ "anony": false,
96
+ "tstamp": 1707765975.0206
97
+ },
98
+ {
99
+ "model_a": "PNP",
100
+ "model_b": "CycleDiffusion",
101
+ "winner": "model_a",
102
+ "judge": "arena_user_::1",
103
+ "anony": true,
104
+ "tstamp": 1707768866.9065
105
+ },
106
+ {
107
+ "model_a": "SDEdit",
108
+ "model_b": "MagicBrush",
109
+ "winner": "model_b",
110
+ "judge": "arena_user_::1",
111
+ "anony": true,
112
+ "tstamp": 1707771673.2989
113
+ },
114
+ {
115
+ "model_a": "SDEdit",
116
+ "model_b": "MagicBrush",
117
+ "winner": "model_b",
118
+ "judge": "arena_user_::1",
119
+ "anony": true,
120
+ "tstamp": 1707784377.6617
121
+ },
122
+ {
123
+ "model_a": "SDEdit",
124
+ "model_b": "MagicBrush",
125
+ "winner": "model_b",
126
+ "judge": "arena_user_::1",
127
+ "anony": true,
128
+ "tstamp": 1707784466.8915
129
+ },
130
+ {
131
+ "model_a": "CycleDiffusion",
132
+ "model_b": "PNP",
133
+ "winner": "model_b",
134
+ "judge": "arena_user_::1",
135
+ "anony": true,
136
+ "tstamp": 1707784983.9581
137
+ },
138
+ {
139
+ "model_a": "MagicBrush",
140
+ "model_b": "SDEdit",
141
+ "winner": "model_a",
142
+ "judge": "arena_user_::1",
143
+ "anony": true,
144
+ "tstamp": 1707785277.16
145
+ },
146
+ {
147
+ "model_a": "MagicBrush",
148
+ "model_b": "SDEdit",
149
+ "winner": "model_a",
150
+ "judge": "arena_user_::1",
151
+ "anony": true,
152
+ "tstamp": 1707795299.0619
153
+ },
154
+ {
155
+ "model_a": "MagicBrush",
156
+ "model_b": "SDEdit",
157
+ "winner": "tie (bothbad)",
158
+ "judge": "arena_user_::1",
159
+ "anony": true,
160
+ "tstamp": 1707795798.752
161
+ },
162
+ {
163
+ "model_a": "SDEdit",
164
+ "model_b": "Prompt2prompt",
165
+ "winner": "model_b",
166
+ "judge": "arena_user_::1",
167
+ "anony": false,
168
+ "tstamp": 1707796435.7996
169
+ },
170
+ {
171
+ "model_a": "SDEdit",
172
+ "model_b": "CycleDiffusion",
173
+ "winner": "model_b",
174
+ "judge": "arena_user_::1",
175
+ "anony": false,
176
+ "tstamp": 1707797278.7369
177
+ },
178
+ {
179
+ "model_a": "SDEdit",
180
+ "model_b": "CycleDiffusion",
181
+ "winner": "model_a",
182
+ "judge": "arena_user_::1",
183
+ "anony": false,
184
+ "tstamp": 1707797279.6004
185
+ },
186
+ {
187
+ "model_a": "SDEdit",
188
+ "model_b": "Prompt2prompt",
189
+ "winner": "model_b",
190
+ "judge": "arena_user_::1",
191
+ "anony": true,
192
+ "tstamp": 1707805086.9739
193
+ },
194
+ {
195
+ "model_a": "PNP",
196
+ "model_b": "SDEdit",
197
+ "winner": "model_a",
198
+ "judge": "arena_user_::1",
199
+ "anony": true,
200
+ "tstamp": 1707805220.3253
201
+ },
202
+ {
203
+ "model_a": "InstructPix2Pix",
204
+ "model_b": "CycleDiffusion",
205
+ "winner": "tie (bothbad)",
206
+ "judge": "arena_user_::1",
207
+ "anony": true,
208
+ "tstamp": 1707805332.6322
209
+ },
210
+ {
211
+ "model_a": "InstructPix2Pix",
212
+ "model_b": "Prompt2prompt",
213
+ "winner": "model_b",
214
+ "judge": "arena_user_::1",
215
+ "anony": true,
216
+ "tstamp": 1707805476.0509
217
+ },
218
+ {
219
+ "model_a": "InstructPix2Pix",
220
+ "model_b": "Prompt2prompt",
221
+ "winner": "model_b",
222
+ "judge": "arena_user_::1",
223
+ "anony": true,
224
+ "tstamp": 1707818374.3438
225
+ },
226
+ {
227
+ "model_a": "PNP",
228
+ "model_b": "Prompt2prompt",
229
+ "winner": "model_b",
230
+ "judge": "arena_user_::1",
231
+ "anony": true,
232
+ "tstamp": 1707834631.9088
233
+ },
234
+ {
235
+ "model_a": "InstructPix2Pix",
236
+ "model_b": "SDEdit",
237
+ "winner": "model_a",
238
+ "judge": "arena_user_::1",
239
+ "anony": true,
240
+ "tstamp": 1707834954.0147
241
+ },
242
+ {
243
+ "model_a": "Prompt2prompt",
244
+ "model_b": "Pix2PixZero",
245
+ "winner": "tie (bothbad)",
246
+ "judge": "arena_user_::1",
247
+ "anony": true,
248
+ "tstamp": 1707835366.544
249
+ },
250
+ {
251
+ "model_a": "PNP",
252
+ "model_b": "SDEdit",
253
+ "winner": "model_a",
254
+ "judge": "arena_user_::1",
255
+ "anony": true,
256
+ "tstamp": 1707835643.6178
257
+ },
258
+ {
259
+ "model_a": "MagicBrush",
260
+ "model_b": "InstructPix2Pix",
261
+ "winner": "tie (bothbad)",
262
+ "judge": "arena_user_::1",
263
+ "anony": true,
264
+ "tstamp": 1707835789.25
265
+ },
266
+ {
267
+ "model_a": "MagicBrush",
268
+ "model_b": "PNP",
269
+ "winner": "tie (bothbad)",
270
+ "judge": "arena_user_::1",
271
+ "anony": true,
272
+ "tstamp": 1707836852.671
273
+ },
274
+ {
275
+ "model_a": "MagicBrush",
276
+ "model_b": "InstructPix2Pix",
277
+ "winner": "model_a",
278
+ "judge": "arena_user_::1",
279
+ "anony": false,
280
+ "tstamp": 1707836952.6082
281
+ },
282
+ {
283
+ "model_a": "CycleDiffusion",
284
+ "model_b": "SDEdit",
285
+ "winner": "tie (bothbad)",
286
+ "judge": "arena_user_::1",
287
+ "anony": false,
288
+ "tstamp": 1707837020.7148
289
+ },
290
+ {
291
+ "model_a": "InstructPix2Pix",
292
+ "model_b": "PNP",
293
+ "winner": "model_a",
294
+ "judge": "arena_user_::1",
295
+ "anony": true,
296
+ "tstamp": 1707837226.2259
297
+ },
298
+ {
299
+ "model_a": "Prompt2prompt",
300
+ "model_b": "Pix2PixZero",
301
+ "winner": "model_a",
302
+ "judge": "arena_user_::1",
303
+ "anony": true,
304
+ "tstamp": 1707838166.1449
305
+ },
306
+ {
307
+ "model_a": "InstructPix2Pix",
308
+ "model_b": "MagicBrush",
309
+ "winner": "tie (bothbad)",
310
+ "judge": "arena_user_::1",
311
+ "anony": true,
312
+ "tstamp": 1707838405.0013
313
+ },
314
+ {
315
+ "model_a": "MagicBrush",
316
+ "model_b": "CycleDiffusion",
317
+ "winner": "model_a",
318
+ "judge": "arena_user_::1",
319
+ "anony": true,
320
+ "tstamp": 1707839133.3126
321
+ },
322
+ {
323
+ "model_a": "Prompt2prompt",
324
+ "model_b": "InstructPix2Pix",
325
+ "winner": "model_a",
326
+ "judge": "arena_user_::1",
327
+ "anony": true,
328
+ "tstamp": 1707839484.6824
329
+ },
330
+ {
331
+ "model_a": "PNP",
332
+ "model_b": "InstructPix2Pix",
333
+ "winner": "tie (bothbad)",
334
+ "judge": "arena_user_::1",
335
+ "anony": true,
336
+ "tstamp": 1707850104.2499
337
+ },
338
+ {
339
+ "model_a": "InstructPix2Pix",
340
+ "model_b": "Pix2PixZero",
341
+ "winner": "model_a",
342
+ "judge": "arena_user_::1",
343
+ "anony": true,
344
+ "tstamp": 1707851384.7689
345
+ },
346
+ {
347
+ "model_a": "PNP",
348
+ "model_b": "MagicBrush",
349
+ "winner": "model_b",
350
+ "judge": "arena_user_::1",
351
+ "anony": true,
352
+ "tstamp": 1707851936.9466
353
+ },
354
+ {
355
+ "model_a": "CycleDiffusion",
356
+ "model_b": "MagicBrush",
357
+ "winner": "tie (bothbad)",
358
+ "judge": "arena_user_::1",
359
+ "anony": true,
360
+ "tstamp": 1707852836.3291
361
+ },
362
+ {
363
+ "model_a": "CycleDiffusion",
364
+ "model_b": "MagicBrush",
365
+ "winner": "tie (bothbad)",
366
+ "judge": "arena_user_::1",
367
+ "anony": false,
368
+ "tstamp": 1707852878.673
369
+ },
370
+ {
371
+ "model_a": "Prompt2prompt",
372
+ "model_b": "InstructPix2Pix",
373
+ "winner": "model_a",
374
+ "judge": "arena_user_::1",
375
+ "anony": true,
376
+ "tstamp": 1707853008.1359
377
+ },
378
+ {
379
+ "model_a": "InstructPix2Pix",
380
+ "model_b": "Pix2PixZero",
381
+ "winner": "model_a",
382
+ "judge": "arena_user_::1",
383
+ "anony": false,
384
+ "tstamp": 1707856807.6229
385
+ },
386
+ {
387
+ "model_a": "MagicBrush",
388
+ "model_b": "Pix2PixZero",
389
+ "winner": "tie (bothbad)",
390
+ "judge": "arena_user_::1",
391
+ "anony": false,
392
+ "tstamp": 1707863740.3507
393
+ },
394
+ {
395
+ "model_a": "MagicBrush",
396
+ "model_b": "PNP",
397
+ "winner": "model_b",
398
+ "judge": "arena_user_::1",
399
+ "anony": true,
400
+ "tstamp": 1707866312.1118
401
+ },
402
+ {
403
+ "model_a": "Pix2PixZero",
404
+ "model_b": "Prompt2prompt",
405
+ "winner": "model_b",
406
+ "judge": "arena_user_::1",
407
+ "anony": true,
408
+ "tstamp": 1707883083.3533
409
+ },
410
+ {
411
+ "model_a": "Pix2PixZero",
412
+ "model_b": "InstructPix2Pix",
413
+ "winner": "model_b",
414
+ "judge": "arena_user_::1",
415
+ "anony": true,
416
+ "tstamp": 1707883181.1397
417
+ },
418
+ {
419
+ "model_a": "Pix2PixZero",
420
+ "model_b": "Prompt2prompt",
421
+ "winner": "model_b",
422
+ "judge": "arena_user_::1",
423
+ "anony": true,
424
+ "tstamp": 1707883187.9173
425
+ },
426
+ {
427
+ "model_a": "PNP",
428
+ "model_b": "Prompt2prompt",
429
+ "winner": "model_a",
430
+ "judge": "arena_user_::1",
431
+ "anony": true,
432
+ "tstamp": 1707883507.587
433
+ },
434
+ {
435
+ "model_a": "Prompt2prompt",
436
+ "model_b": "CycleDiffusion",
437
+ "winner": "model_a",
438
+ "judge": "arena_user_::1",
439
+ "anony": true,
440
+ "tstamp": 1707883939.6125
441
+ },
442
+ {
443
+ "model_a": "Prompt2prompt",
444
+ "model_b": "MagicBrush",
445
+ "winner": "model_b",
446
+ "judge": "arena_user_::1",
447
+ "anony": true,
448
+ "tstamp": 1707892689.4407
449
+ },
450
+ {
451
+ "model_a": "MagicBrush",
452
+ "model_b": "InstructPix2Pix",
453
+ "winner": "model_b",
454
+ "judge": "arena_user_::1",
455
+ "anony": true,
456
+ "tstamp": 1707908988.749
457
+ },
458
+ {
459
+ "model_a": "Prompt2prompt",
460
+ "model_b": "InstructPix2Pix",
461
+ "winner": "model_a",
462
+ "judge": "arena_user_::1",
463
+ "anony": true,
464
+ "tstamp": 1707912639.2701
465
+ },
466
+ {
467
+ "model_a": "MagicBrush",
468
+ "model_b": "Pix2PixZero",
469
+ "winner": "model_a",
470
+ "judge": "arena_user_::1",
471
+ "anony": false,
472
+ "tstamp": 1707917685.9574
473
+ },
474
+ {
475
+ "model_a": "MagicBrush",
476
+ "model_b": "InstructPix2Pix",
477
+ "winner": "tie (bothbad)",
478
+ "judge": "arena_user_::1",
479
+ "anony": false,
480
+ "tstamp": 1707919429.336
481
+ },
482
+ {
483
+ "model_a": "InstructPix2Pix",
484
+ "model_b": "CycleDiffusion",
485
+ "winner": "model_a",
486
+ "judge": "arena_user_::1",
487
+ "anony": true,
488
+ "tstamp": 1707932651.9192
489
+ },
490
+ {
491
+ "model_a": "MagicBrush",
492
+ "model_b": "InstructPix2Pix",
493
+ "winner": "model_a",
494
+ "judge": "arena_user_::1",
495
+ "anony": true,
496
+ "tstamp": 1707932749.3107
497
+ },
498
+ {
499
+ "model_a": "Prompt2prompt",
500
+ "model_b": "PNP",
501
+ "winner": "model_a",
502
+ "judge": "arena_user_::1",
503
+ "anony": true,
504
+ "tstamp": 1707933208.5797
505
+ },
506
+ {
507
+ "model_a": "MagicBrush",
508
+ "model_b": "Pix2PixZero",
509
+ "winner": "model_a",
510
+ "judge": "arena_user_::1",
511
+ "anony": false,
512
+ "tstamp": 1707945335.6341
513
+ },
514
+ {
515
+ "model_a": "MagicBrush",
516
+ "model_b": "PNP",
517
+ "winner": "model_a",
518
+ "judge": "arena_user_::1",
519
+ "anony": false,
520
+ "tstamp": 1708031168.6838
521
+ },
522
+ {
523
+ "model_a": "Pix2PixZero",
524
+ "model_b": "PNP",
525
+ "winner": "model_b",
526
+ "judge": "arena_user_::1",
527
+ "anony": false,
528
+ "tstamp": 1708038931.5388
529
+ },
530
+ {
531
+ "model_a": "Pix2PixZero",
532
+ "model_b": "CycleDiffusion",
533
+ "winner": "tie (bothbad)",
534
+ "judge": "arena_user_::1",
535
+ "anony": true,
536
+ "tstamp": 1708057382.78
537
+ },
538
+ {
539
+ "model_a": "PNP",
540
+ "model_b": "InstructPix2Pix",
541
+ "winner": "model_b",
542
+ "judge": "arena_user_::1",
543
+ "anony": true,
544
+ "tstamp": 1708093689.8237
545
+ },
546
+ {
547
+ "model_a": "MagicBrush",
548
+ "model_b": "PNP",
549
+ "winner": "model_b",
550
+ "judge": "arena_user_::1",
551
+ "anony": true,
552
+ "tstamp": 1708093910.4683
553
+ },
554
+ {
555
+ "model_a": "Pix2PixZero",
556
+ "model_b": "Prompt2prompt",
557
+ "winner": "model_b",
558
+ "judge": "arena_user_::1",
559
+ "anony": false,
560
+ "tstamp": 1708095090.8232
561
+ },
562
+ {
563
+ "model_a": "Pix2PixZero",
564
+ "model_b": "Prompt2prompt",
565
+ "winner": "model_a",
566
+ "judge": "arena_user_::1",
567
+ "anony": false,
568
+ "tstamp": 1708095305.4665
569
+ },
570
+ {
571
+ "model_a": "InstructPix2Pix",
572
+ "model_b": "Prompt2prompt",
573
+ "winner": "model_b",
574
+ "judge": "arena_user_::1",
575
+ "anony": true,
576
+ "tstamp": 1708140553.1694
577
+ },
578
+ {
579
+ "model_a": "MagicBrush",
580
+ "model_b": "Prompt2prompt",
581
+ "winner": "model_a",
582
+ "judge": "arena_user_::1",
583
+ "anony": true,
584
+ "tstamp": 1708145512.3656
585
+ },
586
+ {
587
+ "model_a": "Pix2PixZero",
588
+ "model_b": "Prompt2prompt",
589
+ "winner": "tie (bothbad)",
590
+ "judge": "arena_user_::1",
591
+ "anony": true,
592
+ "tstamp": 1708145724.4127
593
+ },
594
+ {
595
+ "model_a": "Pix2PixZero",
596
+ "model_b": "PNP",
597
+ "winner": "model_b",
598
+ "judge": "arena_user_::1",
599
+ "anony": true,
600
+ "tstamp": 1708146846.5098
601
+ },
602
+ {
603
+ "model_a": "PNP",
604
+ "model_b": "MagicBrush",
605
+ "winner": "model_a",
606
+ "judge": "arena_user_::1",
607
+ "anony": true,
608
+ "tstamp": 1708189738.4864
609
+ },
610
+ {
611
+ "model_a": "Prompt2prompt",
612
+ "model_b": "InstructPix2Pix",
613
+ "winner": "model_b",
614
+ "judge": "arena_user_::1",
615
+ "anony": true,
616
+ "tstamp": 1708235874.9246
617
+ },
618
+ {
619
+ "model_a": "Pix2PixZero",
620
+ "model_b": "PNP",
621
+ "winner": "model_b",
622
+ "judge": "arena_user_::1",
623
+ "anony": false,
624
+ "tstamp": 1708257619.7115
625
+ },
626
+ {
627
+ "model_a": "MagicBrush",
628
+ "model_b": "Pix2PixZero",
629
+ "winner": "tie (bothbad)",
630
+ "judge": "arena_user_::1",
631
+ "anony": true,
632
+ "tstamp": 1708341265.7655
633
+ },
634
+ {
635
+ "model_a": "MagicBrush",
636
+ "model_b": "InstructPix2Pix",
637
+ "winner": "model_b",
638
+ "judge": "arena_user_::1",
639
+ "anony": true,
640
+ "tstamp": 1708350183.3086
641
+ },
642
+ {
643
+ "model_a": "MagicBrush",
644
+ "model_b": "Pix2PixZero",
645
+ "winner": "tie (bothbad)",
646
+ "judge": "arena_user_::1",
647
+ "anony": true,
648
+ "tstamp": 1708399707.1681
649
+ },
650
+ {
651
+ "model_a": "PNP",
652
+ "model_b": "MagicBrush",
653
+ "winner": "model_a",
654
+ "judge": "arena_user_::1",
655
+ "anony": true,
656
+ "tstamp": 1708441502.4707
657
+ },
658
+ {
659
+ "model_a": "InstructPix2Pix",
660
+ "model_b": "MagicBrush",
661
+ "winner": "model_a",
662
+ "judge": "arena_user_::1",
663
+ "anony": true,
664
+ "tstamp": 1708441716.8195
665
+ },
666
+ {
667
+ "model_a": "InstructPix2Pix",
668
+ "model_b": "MagicBrush",
669
+ "winner": "model_b",
670
+ "judge": "arena_user_::1",
671
+ "anony": false,
672
+ "tstamp": 1708546759.2009
673
+ },
674
+ {
675
+ "model_a": "InstructPix2Pix",
676
+ "model_b": "MagicBrush",
677
+ "winner": "model_a",
678
+ "judge": "arena_user_::1",
679
+ "anony": false,
680
+ "tstamp": 1708546805.4892
681
+ },
682
+ {
683
+ "model_a": "Pix2PixZero",
684
+ "model_b": "CycleDiffusion",
685
+ "winner": "tie (bothbad)",
686
+ "judge": "arena_user_::1",
687
+ "anony": true,
688
+ "tstamp": 1708547082.7124
689
+ },
690
+ {
691
+ "model_a": "InstructPix2Pix",
692
+ "model_b": "MagicBrush",
693
+ "winner": "model_b",
694
+ "judge": "arena_user_::1",
695
+ "anony": false,
696
+ "tstamp": 1708547166.9685
697
+ },
698
+ {
699
+ "model_a": "InstructPix2Pix",
700
+ "model_b": "MagicBrush",
701
+ "winner": "model_b",
702
+ "judge": "arena_user_::1",
703
+ "anony": false,
704
+ "tstamp": 1708547293.7107
705
+ },
706
+ {
707
+ "model_a": "CycleDiffusion",
708
+ "model_b": "PNP",
709
+ "winner": "tie (bothbad)",
710
+ "judge": "arena_user_::1",
711
+ "anony": true,
712
+ "tstamp": 1708575046.0529
713
+ },
714
+ {
715
+ "model_a": "CycleDiffusion",
716
+ "model_b": "MagicBrush",
717
+ "winner": "tie (bothbad)",
718
+ "judge": "arena_user_::1",
719
+ "anony": true,
720
+ "tstamp": 1708615466.9264
721
+ },
722
+ {
723
+ "model_a": "CycleDiffusion",
724
+ "model_b": "MagicBrush",
725
+ "winner": "model_b",
726
+ "judge": "arena_user_::1",
727
+ "anony": false,
728
+ "tstamp": 1708615516.3341
729
+ },
730
+ {
731
+ "model_a": "InstructPix2Pix",
732
+ "model_b": "PNP",
733
+ "winner": "model_b",
734
+ "judge": "arena_user_::1",
735
+ "anony": false,
736
+ "tstamp": 1709205399.0098
737
+ },
738
+ {
739
+ "model_a": "InstructPix2Pix",
740
+ "model_b": "PNP",
741
+ "winner": "model_b",
742
+ "judge": "arena_user_::1",
743
+ "anony": false,
744
+ "tstamp": 1709205767.8923
745
+ },
746
+ {
747
+ "model_a": "PNP",
748
+ "model_b": "InstructPix2Pix",
749
+ "winner": "model_b",
750
+ "judge": "arena_user_::1",
751
+ "anony": true,
752
+ "tstamp": 1709443700.05
753
+ },
754
+ {
755
+ "model_a": "MagicBrush",
756
+ "model_b": "Pix2PixZero",
757
+ "winner": "model_a",
758
+ "judge": "arena_user_::1",
759
+ "anony": true,
760
+ "tstamp": 1709702898.9291
761
+ },
762
+ {
763
+ "model_a": "CycleDiffusion",
764
+ "model_b": "Prompt2prompt",
765
+ "winner": "tie (bothbad)",
766
+ "judge": "arena_user_::1",
767
+ "anony": true,
768
+ "tstamp": 1710091925.1861
769
+ },
770
+ {
771
+ "model_a": "MagicBrush",
772
+ "model_b": "InstructPix2Pix",
773
+ "winner": "tie (bothbad)",
774
+ "judge": "arena_user_::1",
775
+ "anony": true,
776
+ "tstamp": 1710517781.1525
777
+ },
778
+ {
779
+ "model_a": "MagicBrush",
780
+ "model_b": "InstructPix2Pix",
781
+ "winner": "tie (bothbad)",
782
+ "judge": "arena_user_::1",
783
+ "anony": false,
784
+ "tstamp": 1710517859.2942
785
+ },
786
+ {
787
+ "model_a": "Pix2PixZero",
788
+ "model_b": "CycleDiffusion",
789
+ "winner": "tie (bothbad)",
790
+ "judge": "arena_user_::1",
791
+ "anony": true,
792
+ "tstamp": 1710535672.9791
793
+ },
794
+ {
795
+ "model_a": "CycleDiffusion",
796
+ "model_b": "Pix2PixZero",
797
+ "winner": "model_b",
798
+ "judge": "arena_user_10.16.25.191",
799
+ "anony": false,
800
+ "tstamp": 1711610477.1213
801
+ },
802
+ {
803
+ "model_a": "CycleDiffusion",
804
+ "model_b": "Pix2PixZero",
805
+ "winner": "model_b",
806
+ "judge": "arena_user_10.16.7.189",
807
+ "anony": false,
808
+ "tstamp": 1711629129.3894
809
+ },
810
+ {
811
+ "model_a": "InstructPix2Pix",
812
+ "model_b": "CycleDiffusion",
813
+ "winner": "model_b",
814
+ "judge": "arena_user_10.16.7.189",
815
+ "anony": false,
816
+ "tstamp": 1711629705.2246
817
+ },
818
+ {
819
+ "model_a": "CycleDiffusion",
820
+ "model_b": "Pix2PixZero",
821
+ "winner": "model_b",
822
+ "judge": "arena_user_10.16.25.191",
823
+ "anony": false,
824
+ "tstamp": 1711630362.5575
825
+ },
826
+ {
827
+ "model_a": "MagicBrush",
828
+ "model_b": "SDEdit",
829
+ "winner": "model_a",
830
+ "judge": "arena_user_127.0.0.1",
831
+ "anony": false,
832
+ "tstamp": 1711631112.5207
833
+ },
834
+ {
835
+ "model_a": "Pix2PixZero",
836
+ "model_b": "Prompt2prompt",
837
+ "winner": "model_a",
838
+ "judge": "arena_user_10.16.41.118",
839
+ "anony": false,
840
+ "tstamp": 1711631690.5127
841
+ },
842
+ {
843
+ "model_a": "MagicBrush",
844
+ "model_b": "InstructPix2Pix",
845
+ "winner": "model_a",
846
+ "judge": "arena_user_127.0.0.1",
847
+ "anony": false,
848
+ "tstamp": 1711633200.2923
849
+ },
850
+ {
851
+ "model_a": "MagicBrush",
852
+ "model_b": "InstructPix2Pix",
853
+ "winner": "model_a",
854
+ "judge": "arena_user_127.0.0.1",
855
+ "anony": false,
856
+ "tstamp": 1711633594.9922
857
+ },
858
+ {
859
+ "model_a": "MagicBrush",
860
+ "model_b": "SDEdit",
861
+ "winner": "model_a",
862
+ "judge": "arena_user_10.16.7.189",
863
+ "anony": false,
864
+ "tstamp": 1711635443.3071
865
+ },
866
+ {
867
+ "model_a": "CycleDiffusion",
868
+ "model_b": "MagicBrush",
869
+ "winner": "model_b",
870
+ "judge": "arena_user_10.16.25.191",
871
+ "anony": false,
872
+ "tstamp": 1711635899.3088
873
+ },
874
+ {
875
+ "model_a": "SDEdit",
876
+ "model_b": "MagicBrush",
877
+ "winner": "model_b",
878
+ "judge": "arena_user_10.16.41.118",
879
+ "anony": false,
880
+ "tstamp": 1711639015.428
881
+ },
882
+ {
883
+ "model_a": "InstructPix2Pix",
884
+ "model_b": "MagicBrush",
885
+ "winner": "model_b",
886
+ "judge": "arena_user_10.16.7.189",
887
+ "anony": false,
888
+ "tstamp": 1711646372.1201
889
+ },
890
+ {
891
+ "model_a": "Pix2PixZero",
892
+ "model_b": "Prompt2prompt",
893
+ "winner": "model_b",
894
+ "judge": "arena_user_10.16.17.217",
895
+ "anony": false,
896
+ "tstamp": 1712873850.0636
897
+ }
898
+ ]
arena_elo/results/20240411/elo_results_image_editing.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a470ecf82163c5288ecc888f68cbd66c44c087f3c9935ad7c1d57638774c07b7
3
+ size 57073
arena_elo/results/20240411/image_editing_leaderboard.csv ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ Prompt2prompt,Prompt2prompt,1227.5508595026165,1165.1074631901067,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
3
+ InstructPix2Pix,InstructPix2Pix,1160.2057367236093,1071.6130715646666,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
4
+ PNP,PNP,1142.693603173293,1165.4943769506524,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
5
+ MagicBrush,MagicBrush,1053.1728944865915,1130.1989463143677,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
6
+ Pix2PixZero,Pix2PixZero,918.6047552604578,954.5255168029421,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io
7
+ CycleDiffusion,CycleDiffusion,865.0529105743963,812.4628200722799,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
8
+ SDEdit,SDEdit,632.7192402790356,700.5978051049844,MIT License,Stanford University,https://sde-image-editing.github.io
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -886,5 +886,13 @@
886
  "judge": "arena_user_10.16.7.189",
887
  "anony": false,
888
  "tstamp": 1711646372.1201
 
 
 
 
 
 
 
 
889
  }
890
  ]
 
886
  "judge": "arena_user_10.16.7.189",
887
  "anony": false,
888
  "tstamp": 1711646372.1201
889
+ },
890
+ {
891
+ "model_a": "Pix2PixZero",
892
+ "model_b": "Prompt2prompt",
893
+ "winner": "model_b",
894
+ "judge": "arena_user_10.16.17.217",
895
+ "anony": false,
896
+ "tstamp": 1712873850.0636
897
  }
898
  ]
arena_elo/results/latest/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1430e6703dd6fc1e5b8ce06b11bb3a47516763a33edaf99e4c8547da5d9a8516
3
- size 57064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a470ecf82163c5288ecc888f68cbd66c44c087f3c9935ad7c1d57638774c07b7
3
+ size 57073
arena_elo/results/latest/image_editing_leaderboard.csv CHANGED
@@ -1,8 +1,8 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- Prompt2prompt,Prompt2prompt,1227.5508595026165,1158.5510681980204,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
3
- InstructPix2Pix,InstructPix2Pix,1160.2057367236093,1071.0628993075604,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
4
- PNP,PNP,1142.693603173293,1165.4957550490212,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
5
- MagicBrush,MagicBrush,1053.1728944865915,1130.5422054860635,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
6
- Pix2PixZero,Pix2PixZero,918.6047552604578,960.3217617445996,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io
7
- CycleDiffusion,CycleDiffusion,865.0529105743963,813.4794423328381,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
8
- SDEdit,SDEdit,632.7192402790356,700.546867881897,MIT License,Stanford University,https://sde-image-editing.github.io
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ Prompt2prompt,Prompt2prompt,1227.5508595026165,1165.1074631901067,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io
3
+ InstructPix2Pix,InstructPix2Pix,1160.2057367236093,1071.6130715646666,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
4
+ PNP,PNP,1142.693603173293,1165.4943769506524,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
5
+ MagicBrush,MagicBrush,1053.1728944865915,1130.1989463143677,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush
6
+ Pix2PixZero,Pix2PixZero,918.6047552604578,954.5255168029421,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io
7
+ CycleDiffusion,CycleDiffusion,865.0529105743963,812.4628200722799,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion
8
+ SDEdit,SDEdit,632.7192402790356,700.5978051049844,MIT License,Stanford University,https://sde-image-editing.github.io