Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
cf709ea
•
1 Parent(s): 2e943ad

Auto Daily Leaderboard udpate Wed Aug 21 12:00:23 PM EDT 2024

Browse files
Files changed (12) hide show
  1. arena_elo/results/20240821/clean_battle_t2i_generation.json +0 -0
  2. arena_elo/results/20240821/clean_battle_video_generation.json +0 -0
  3. arena_elo/results/20240821/elo_results_t2i_generation.pkl +3 -0
  4. arena_elo/results/20240821/elo_results_video_generation.pkl +3 -0
  5. arena_elo/results/20240821/t2i_generation_leaderboard.csv +18 -0
  6. arena_elo/results/20240821/video_generation_leaderboard.csv +11 -0
  7. arena_elo/results/latest/clean_battle_t2i_generation.json +56 -0
  8. arena_elo/results/latest/clean_battle_video_generation.json +8 -0
  9. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  10. arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
  11. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
  12. arena_elo/results/latest/video_generation_leaderboard.csv +10 -10
arena_elo/results/20240821/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240821/clean_battle_video_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20240821/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd1660b033bc489c5fbf211b9c528554be5cfcf5135641290ad6a9d7125d7db3
3
+ size 88247
arena_elo/results/20240821/elo_results_video_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71584f88bde54f52c66f689c8ad20b2bb93c16ed49c295c69016654866ca7157
3
+ size 66377
arena_elo/results/20240821/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1133.2628901237126,1133.5940204922306,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1132.2734262471183,1153.2359360195053,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ PlayGround V2,PlayGround V2,1077.6123248465824,1074.9920036115682,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
5
+ FLUX.1-schnell,FLUX.1-schnell,1067.2499071169384,1061.3666497454988,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
6
+ HunyuanDiT,HunyuanDiT,1054.1087777967914,1039.1876605139332,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
7
+ StableCascade,StableCascade,1041.2839169103206,1043.297234391808,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ PixArtAlpha,PixArtAlpha,1028.6598617906304,1017.1043669696825,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
9
+ SDXL-Lightning,SDXL-Lightning,1027.899037750196,1030.7742333287965,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtSigma,PixArtSigma,1022.6398294247064,1021.1258277633667,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ AuraFlow,AuraFlow,1016.4699519667773,1010.5604537602092,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
12
+ SD3,SD3,992.874758843956,987.0699372711239,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ Kolors,Kolors,981.9348309085461,977.9500512330701,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
14
+ SDXL,SDXL,968.8815288910846,968.0077346632698,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,917.5189860695493,913.4573538053112,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),910.0117686080641,902.462691086812,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,832.7470581402116,825.8362440920455,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,794.5711445648155,806.747578423868,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/20240821/video_generation_leaderboard.csv ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1143.2191298083312,1148.6171855419145,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ T2V-Turbo,T2V-Turbo,1092.4551860072625,1093.3461900064547,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
4
+ VideoCrafter2,VideoCrafter2,1076.7797371219958,1079.2747502130292,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
5
+ AnimateDiff,AnimateDiff,1071.9888858847867,1072.4659107742777,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
6
+ CogVideoX,CogVideoX,1046.417835182279,1048.0267833837986,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
7
+ LaVie,LaVie,999.6270938177271,1001.6116131699212,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora v1.2,OpenSora v1.2,924.0203683794037,903.7581037865372,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora,OpenSora,916.0498767986071,917.9017410924956,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,865.3398542588171,868.8554259930636,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,864.1020327407906,866.1422960385084,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -52502,5 +52502,61 @@
52502
  "judge": "arena_user_10.16.18.75",
52503
  "anony": true,
52504
  "tstamp": 1724204524.4511
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52505
  }
52506
  ]
 
52502
  "judge": "arena_user_10.16.18.75",
52503
  "anony": true,
52504
  "tstamp": 1724204524.4511
52505
+ },
52506
+ {
52507
+ "model_a": "FLUX.1-schnell",
52508
+ "model_b": "FLUX.1-dev",
52509
+ "winner": "model_b",
52510
+ "judge": "arena_user_10.16.34.60",
52511
+ "anony": false,
52512
+ "tstamp": 1724230659.1573
52513
+ },
52514
+ {
52515
+ "model_a": "PlayGround V2.5",
52516
+ "model_b": "FLUX.1-schnell",
52517
+ "winner": "tie",
52518
+ "judge": "arena_user_10.16.18.162",
52519
+ "anony": true,
52520
+ "tstamp": 1724237747.0976
52521
+ },
52522
+ {
52523
+ "model_a": "SDXL-Lightning",
52524
+ "model_b": "PixArtAlpha",
52525
+ "winner": "model_b",
52526
+ "judge": "arena_user_10.16.18.162",
52527
+ "anony": true,
52528
+ "tstamp": 1724248013.5766
52529
+ },
52530
+ {
52531
+ "model_a": "AuraFlow",
52532
+ "model_b": "SDXL-Lightning",
52533
+ "winner": "model_b",
52534
+ "judge": "arena_user_10.16.1.165",
52535
+ "anony": true,
52536
+ "tstamp": 1724250894.864
52537
+ },
52538
+ {
52539
+ "model_a": "PlayGround V2.5",
52540
+ "model_b": "FLUX.1-schnell",
52541
+ "winner": "tie",
52542
+ "judge": "arena_user_10.16.18.75",
52543
+ "anony": true,
52544
+ "tstamp": 1724254894.0143
52545
+ },
52546
+ {
52547
+ "model_a": "PlayGround V2.5",
52548
+ "model_b": "OpenJourney",
52549
+ "winner": "tie",
52550
+ "judge": "arena_user_10.16.18.162",
52551
+ "anony": true,
52552
+ "tstamp": 1724254913.5008
52553
+ },
52554
+ {
52555
+ "model_a": "PlayGround V2.5",
52556
+ "model_b": "AuraFlow",
52557
+ "winner": "model_a",
52558
+ "judge": "arena_user_10.16.1.165",
52559
+ "anony": true,
52560
+ "tstamp": 1724255141.5267
52561
  }
52562
  ]
arena_elo/results/latest/clean_battle_video_generation.json CHANGED
@@ -15022,5 +15022,13 @@
15022
  "judge": "arena_user_10.16.34.60",
15023
  "anony": true,
15024
  "tstamp": 1724127663.1705
 
 
 
 
 
 
 
 
15025
  }
15026
  ]
 
15022
  "judge": "arena_user_10.16.34.60",
15023
  "anony": true,
15024
  "tstamp": 1724127663.1705
15025
+ },
15026
+ {
15027
+ "model_a": "StableVideoDiffusion",
15028
+ "model_b": "AnimateDiff",
15029
+ "winner": "model_a",
15030
+ "judge": "arena_user_10.16.1.165",
15031
+ "anony": false,
15032
+ "tstamp": 1724230954.5847
15033
  }
15034
  ]
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a55e58f091b88f7cc16382c56b7d655cbcd86bd23c3f3de214ef5484edfd1e4d
3
  size 88247
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd1660b033bc489c5fbf211b9c528554be5cfcf5135641290ad6a9d7125d7db3
3
  size 88247
arena_elo/results/latest/elo_results_video_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7c42587eea0a948a9cbd5cca3b94e8141e70bcb9a0ae86646bc22973ea44332a
3
  size 66377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71584f88bde54f52c66f689c8ad20b2bb93c16ed49c295c69016654866ca7157
3
  size 66377
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- PlayGround V2.5,PlayGround V2.5,1132.890132362509,1133.2132994392719,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
- FLUX.1-dev,FLUX.1-dev,1130.7155148553181,1147.438205902597,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
- PlayGround V2,PlayGround V2,1076.980283311089,1074.3249013429554,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
5
- FLUX.1-schnell,FLUX.1-schnell,1066.4020402818517,1062.8730931830312,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
6
- HunyuanDiT,HunyuanDiT,1053.572229850288,1038.703774370632,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
7
- StableCascade,StableCascade,1040.7649360610326,1042.7543257183775,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- AuraFlow,AuraFlow,1028.6476636951288,1021.8888350731722,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
9
- PixArtAlpha,PixArtAlpha,1027.5984425989943,1016.2046020683781,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
- SDXL-Lightning,SDXL-Lightning,1027.28056074664,1030.1892737463068,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
- PixArtSigma,PixArtSigma,1022.278191734517,1020.5244848333533,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- SD3,SD3,992.4683734086498,986.8567562452171,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- Kolors,Kolors,980.5720834009985,977.940378018964,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
14
- SDXL,SDXL,968.286211097592,967.3440457396239,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,916.9664722660239,912.8537618702409,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),909.2587727377047,901.7564308088253,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,831.6663894963693,825.0727531727863,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,793.6517020952907,806.0428762517084,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ PlayGround V2.5,PlayGround V2.5,1133.2628901237126,1133.5940204922306,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
3
+ FLUX.1-dev,FLUX.1-dev,1132.2734262471183,1153.2359360195053,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
4
+ PlayGround V2,PlayGround V2,1077.6123248465824,1074.9920036115682,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
5
+ FLUX.1-schnell,FLUX.1-schnell,1067.2499071169384,1061.3666497454988,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
6
+ HunyuanDiT,HunyuanDiT,1054.1087777967914,1039.1876605139332,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
7
+ StableCascade,StableCascade,1041.2839169103206,1043.297234391808,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ PixArtAlpha,PixArtAlpha,1028.6598617906304,1017.1043669696825,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
9
+ SDXL-Lightning,SDXL-Lightning,1027.899037750196,1030.7742333287965,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
10
+ PixArtSigma,PixArtSigma,1022.6398294247064,1021.1258277633667,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ AuraFlow,AuraFlow,1016.4699519667773,1010.5604537602092,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
12
+ SD3,SD3,992.874758843956,987.0699372711239,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ Kolors,Kolors,981.9348309085461,977.9500512330701,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
14
+ SDXL,SDXL,968.8815288910846,968.0077346632698,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,917.5189860695493,913.4573538053112,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),910.0117686080641,902.462691086812,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,832.7470581402116,825.8362440920455,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,794.5711445648155,806.747578423868,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/video_generation_leaderboard.csv CHANGED
@@ -1,11 +1,11 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- StableVideoDiffusion,StableVideoDiffusion,1143.2191298083312,1147.5193110801638,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
- T2V-Turbo,T2V-Turbo,1092.4551860072625,1093.43771637836,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
4
- VideoCrafter2,VideoCrafter2,1076.7797371219958,1079.3282160297892,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
5
- AnimateDiff,AnimateDiff,1071.9888858847867,1073.0390578256142,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
6
- CogVideoX,CogVideoX,1046.417835182279,1048.070311411077,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
7
- LaVie,LaVie,999.6270938177271,1001.6816790561326,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
- OpenSora v1.2,OpenSora v1.2,924.0203683794037,903.7447677401199,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
- OpenSora,OpenSora,916.0498767986071,917.9961732110512,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
- ModelScope,ModelScope,865.3398542588171,868.9309810684535,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
- AnimateDiff Turbo,AnimateDiff Turbo,864.1020327407906,866.2517861992403,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ StableVideoDiffusion,StableVideoDiffusion,1143.2191298083312,1148.6171855419145,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
3
+ T2V-Turbo,T2V-Turbo,1092.4551860072625,1093.3461900064547,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
4
+ VideoCrafter2,VideoCrafter2,1076.7797371219958,1079.2747502130292,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
5
+ AnimateDiff,AnimateDiff,1071.9888858847867,1072.4659107742777,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
6
+ CogVideoX,CogVideoX,1046.417835182279,1048.0267833837986,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
7
+ LaVie,LaVie,999.6270938177271,1001.6116131699212,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
8
+ OpenSora v1.2,OpenSora v1.2,924.0203683794037,903.7581037865372,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
9
+ OpenSora,OpenSora,916.0498767986071,917.9017410924956,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
10
+ ModelScope,ModelScope,865.3398542588171,868.8554259930636,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
11
+ AnimateDiff Turbo,AnimateDiff Turbo,864.1020327407906,866.1422960385084,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo