Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
79cd731
•
1 Parent(s): 4deb581

update

Browse files
Files changed (14) hide show
  1. arena_elo/results/20240916/clean_battle_image_editing.json +0 -0
  2. arena_elo/results/20240916/clean_battle_t2i_generation.json +0 -0
  3. arena_elo/results/20240916/clean_battle_video_generation.json +0 -0
  4. arena_elo/results/20240916/elo_results_t2i_generation.pkl +3 -0
  5. arena_elo/results/20240916/elo_results_video_generation.pkl +3 -0
  6. arena_elo/results/20240916/t2i_generation_leaderboard.csv +18 -0
  7. arena_elo/results/20240916/video_generation_leaderboard.csv +11 -0
  8. arena_elo/results/latest/clean_battle_image_editing.json +16 -0
  9. arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
  10. arena_elo/results/latest/clean_battle_video_generation.json +14 -0
  11. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  12. arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
  13. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
  14. arena_elo/results/latest/video_generation_leaderboard.csv +10 -10
arena_elo/results/20240916/clean_battle_image_editing.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240916/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240916/clean_battle_video_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240916/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4c6752be46fba8b756edf47718f0fada6498f37836e33e7f40fc1b00ae6d7f4
3
+ size 88247
arena_elo/results/20240916/elo_results_video_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7af04e7635973b87326e65154667a7dbe38ddeb5c522636eaf249a3365ab16b
3
+ size 66385
arena_elo/results/20240916/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1127.158783576599,1127.605606573337,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1126.3373070294942,1145.8128196095035,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1080.5577770773225,1080.0699682853756,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.6037161805239,1071.1940881798405,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1055.66034995763,1052.4971357305214,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1038.5006286772439,1040.5759137623338,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1038.5001382702083,1026.566658969686,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ SDXL-Lightning,SDXL-Lightning,1024.6449463970316,1027.6897934353565,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtAlpha,PixArtAlpha,1022.7625763796838,1011.9484046884448,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
+ PixArtSigma,PixArtSigma,1019.5517866111454,1018.1160601947661,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ AuraFlow,AuraFlow,997.7339786454594,988.5369362011227,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
+ SD3,SD3,989.8309269141221,984.860418192809,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
+ SDXL,SDXL,965.3351197250997,964.7885601095076,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,914.2683859436904,910.3991546599102,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),906.198381029206,898.8753090549322,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.9474591439639,822.4986149560198,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,790.407738441576,803.0736374065596,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/20240916/video_generation_leaderboard.csv ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1150.6318316907511,1154.9642392684493,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ T2V-Turbo,T2V-Turbo,1091.7739607365017,1091.610375043803,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
4
+ CogVideoX-2B,CogVideoX-2B,1081.4600340680515,1071.12327391069,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
5
+ VideoCrafter2,VideoCrafter2,1078.9567942425863,1080.602170373091,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
+ AnimateDiff,AnimateDiff,1074.9631708499437,1074.6280510123086,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
+ LaVie,LaVie,1001.7666751262643,1003.2535623222024,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora,OpenSora,917.9305542998153,919.1709508669146,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora v1.2,OpenSora v1.2,869.6418661868402,867.4757096148518,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,867.5742880140327,870.4067950854605,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,865.3008247852126,866.7648725022292,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -18744,5 +18744,21 @@
18744
  "judge": "arena_user_10.16.18.162",
18745
  "anony": true,
18746
  "tstamp": 1725658918.1797
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18747
  }
18748
  ]
 
18744
  "judge": "arena_user_10.16.18.162",
18745
  "anony": true,
18746
  "tstamp": 1725658918.1797
18747
+ },
18748
+ {
18749
+ "model_a_conv_id": "3236bad678db4dd4a20427ca988681d4",
18750
+ "model_b_conv_id": "98423b8cd91e4ce892ee0d6116873c9e",
18751
+ "inputs": {
18752
+ "source_prompt": "The Washington Monument with kites flying in the sky around it.",
18753
+ "target_prompt": "The Statue of Liberty with kites flying in the sky around it.",
18754
+ "instruct_prompt": "change the Washington Monument with the Statue of Liberty"
18755
+ },
18756
+ "model_a": "PNP",
18757
+ "model_b": "UltraEdit",
18758
+ "vote_type": "leftvote",
18759
+ "winner": "model_a",
18760
+ "judge": "arena_user_10.16.10.147",
18761
+ "anony": true,
18762
+ "tstamp": 1726511377.5162
18763
  }
18764
  ]
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -96174,5 +96174,19 @@
96174
  "judge": "arena_user_10.16.34.60",
96175
  "anony": true,
96176
  "tstamp": 1725721387.0699
 
 
 
 
 
 
 
 
 
 
 
 
 
 
96177
  }
96178
  ]
 
96174
  "judge": "arena_user_10.16.34.60",
96175
  "anony": true,
96176
  "tstamp": 1725721387.0699
96177
+ },
96178
+ {
96179
+ "model_a_conv_id": "a341d91fd8054486a7bcbea1595136ad",
96180
+ "model_b_conv_id": "61cb0b4358a34d9c802ba90ac28ce6e1",
96181
+ "inputs": {
96182
+ "prompt": "A long green train traveling through a rural orange countryside ."
96183
+ },
96184
+ "model_a": "PlayGround V2.5",
96185
+ "model_b": "HunyuanDiT",
96186
+ "vote_type": "leftvote",
96187
+ "winner": "model_a",
96188
+ "judge": "arena_user_10.16.18.75",
96189
+ "anony": true,
96190
+ "tstamp": 1726511354.325
96191
  }
96192
  ]
arena_elo/results/latest/clean_battle_video_generation.json CHANGED
@@ -27116,5 +27116,19 @@
27116
  "judge": "arena_user_10.16.18.162",
27117
  "anony": true,
27118
  "tstamp": 1725064216.8209
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27119
  }
27120
  ]
 
27116
  "judge": "arena_user_10.16.18.162",
27117
  "anony": true,
27118
  "tstamp": 1725064216.8209
27119
+ },
27120
+ {
27121
+ "model_a_conv_id": "c4408c684a6a4235b6660f08fe6d2f5f",
27122
+ "model_b_conv_id": "1e6d53001a6541358c3a8f7368c5fac2",
27123
+ "inputs": {
27124
+ "prompt": "outdoor track"
27125
+ },
27126
+ "model_a": "VideoCrafter2",
27127
+ "model_b": "CogVideoX-2B",
27128
+ "vote_type": "rightvote",
27129
+ "winner": "model_b",
27130
+ "judge": "arena_user_10.16.18.75",
27131
+ "anony": true,
27132
+ "tstamp": 1726511242.7168
27133
  }
27134
  ]
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3abf30eaed4a14868db7d75bf665e54939f9a8260844a8b067a9971b1952fef3
3
  size 88247
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4c6752be46fba8b756edf47718f0fada6498f37836e33e7f40fc1b00ae6d7f4
3
  size 88247
arena_elo/results/latest/elo_results_video_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3196975d9ec53ef46258ff64917717d8fd195e9935940dff8a0a283af772b3b0
3
  size 66385
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7af04e7635973b87326e65154667a7dbe38ddeb5c522636eaf249a3365ab16b
3
  size 66385
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1126.8163301214895,1127.2649468089273,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- FLUX.1-dev,FLUX.1-dev,1126.0721216782244,1145.8317939161764,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
- FLUX.1-schnell,FLUX.1-schnell,1080.6437103153228,1080.028689167911,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1073.4393034122365,1071.0953389840586,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1055.8131607164855,1052.5367877751423,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- HunyuanDiT,HunyuanDiT,1039.6247294773034,1027.5553176591982,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
8
- StableCascade,StableCascade,1038.503364291083,1040.4925359161466,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
9
- SDXL-Lightning,SDXL-Lightning,1024.6674430167477,1027.618845555247,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
- PixArtAlpha,PixArtAlpha,1022.6915349299396,1011.872997925934,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
- PixArtSigma,PixArtSigma,1019.5072680991525,1018.0621667213067,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- AuraFlow,AuraFlow,997.7561897276669,988.5624138101551,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
- SD3,SD3,989.7708398500049,984.8956034155048,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
- SDXL,SDXL,965.2029214915333,964.71647140578,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,914.190563890211,910.3261232771027,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),906.0670953509358,898.7869948946318,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,828.8125289712327,822.430869650419,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,790.4208946604244,802.9929269937835,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1127.158783576599,1127.605606573337,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1126.3373070294942,1145.8128196095035,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ FLUX.1-schnell,FLUX.1-schnell,1080.5577770773225,1080.0699682853756,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.6037161805239,1071.1940881798405,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1055.66034995763,1052.4971357305214,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1038.5006286772439,1040.5759137623338,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1038.5001382702083,1026.566658969686,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ SDXL-Lightning,SDXL-Lightning,1024.6449463970316,1027.6897934353565,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtAlpha,PixArtAlpha,1022.7625763796838,1011.9484046884448,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
11
+ PixArtSigma,PixArtSigma,1019.5517866111454,1018.1160601947661,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ AuraFlow,AuraFlow,997.7339786454594,988.5369362011227,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
13
+ SD3,SD3,989.8309269141221,984.860418192809,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
14
+ SDXL,SDXL,965.3351197250997,964.7885601095076,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,914.2683859436904,910.3991546599102,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),906.198381029206,898.8753090549322,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,828.9474591439639,822.4986149560198,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,790.407738441576,803.0736374065596,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/video_generation_leaderboard.csv CHANGED
@@ -1,11 +1,11 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- StableVideoDiffusion,StableVideoDiffusion,1151.6931814883521,1155.975431609357,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
- T2V-Turbo,T2V-Turbo,1092.6793648951773,1092.5316889749017,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
4
- VideoCrafter2,VideoCrafter2,1080.8536998864654,1082.46685267181,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
5
- AnimateDiff,AnimateDiff,1076.1520720608496,1075.7582897814661,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
6
- CogVideoX-2B,CogVideoX-2B,1070.229911493377,1062.0520921077534,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
7
- LaVie,LaVie,1003.2012616933093,1004.514801245956,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
- OpenSora,OpenSora,919.368939929722,920.4525622825817,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
- OpenSora v1.2,OpenSora v1.2,870.1525593858826,866.5621220164295,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
- ModelScope,ModelScope,869.0133783533573,871.6942492615718,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
- AnimateDiff Turbo,AnimateDiff Turbo,866.6556308135064,867.9919100481715,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1150.6318316907511,1154.9642392684493,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ T2V-Turbo,T2V-Turbo,1091.7739607365017,1091.610375043803,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
4
+ CogVideoX-2B,CogVideoX-2B,1081.4600340680515,1071.12327391069,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
5
+ VideoCrafter2,VideoCrafter2,1078.9567942425863,1080.602170373091,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
6
+ AnimateDiff,AnimateDiff,1074.9631708499437,1074.6280510123086,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
7
+ LaVie,LaVie,1001.7666751262643,1003.2535623222024,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora,OpenSora,917.9305542998153,919.1709508669146,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora v1.2,OpenSora v1.2,869.6418661868402,867.4757096148518,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,867.5742880140327,870.4067950854605,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,865.3008247852126,866.7648725022292,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo