Spaces:
Running
on
Zero
Running
on
Zero
Commit
•
cf709ea
1
Parent(s):
2e943ad
Auto Daily Leaderboard udpate Wed Aug 21 12:00:23 PM EDT 2024
Browse files- arena_elo/results/20240821/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20240821/clean_battle_video_generation.json +0 -0
- arena_elo/results/20240821/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20240821/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20240821/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/20240821/video_generation_leaderboard.csv +11 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +56 -0
- arena_elo/results/latest/clean_battle_video_generation.json +8 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
- arena_elo/results/latest/video_generation_leaderboard.csv +10 -10
arena_elo/results/20240821/clean_battle_t2i_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20240821/clean_battle_video_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20240821/elo_results_t2i_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cd1660b033bc489c5fbf211b9c528554be5cfcf5135641290ad6a9d7125d7db3
|
3 |
+
size 88247
|
arena_elo/results/20240821/elo_results_video_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:71584f88bde54f52c66f689c8ad20b2bb93c16ed49c295c69016654866ca7157
|
3 |
+
size 66377
|
arena_elo/results/20240821/t2i_generation_leaderboard.csv
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
PlayGround V2.5,PlayGround V2.5,1133.2628901237126,1133.5940204922306,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
3 |
+
FLUX.1-dev,FLUX.1-dev,1132.2734262471183,1153.2359360195053,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
4 |
+
PlayGround V2,PlayGround V2,1077.6123248465824,1074.9920036115682,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
5 |
+
FLUX.1-schnell,FLUX.1-schnell,1067.2499071169384,1061.3666497454988,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
6 |
+
HunyuanDiT,HunyuanDiT,1054.1087777967914,1039.1876605139332,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
7 |
+
StableCascade,StableCascade,1041.2839169103206,1043.297234391808,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
PixArtAlpha,PixArtAlpha,1028.6598617906304,1017.1043669696825,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
9 |
+
SDXL-Lightning,SDXL-Lightning,1027.899037750196,1030.7742333287965,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
10 |
+
PixArtSigma,PixArtSigma,1022.6398294247064,1021.1258277633667,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
11 |
+
AuraFlow,AuraFlow,1016.4699519667773,1010.5604537602092,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
12 |
+
SD3,SD3,992.874758843956,987.0699372711239,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
Kolors,Kolors,981.9348309085461,977.9500512330701,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
14 |
+
SDXL,SDXL,968.8815288910846,968.0077346632698,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,917.5189860695493,913.4573538053112,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),910.0117686080641,902.462691086812,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,832.7470581402116,825.8362440920455,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,794.5711445648155,806.747578423868,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/20240821/video_generation_leaderboard.csv
ADDED
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
StableVideoDiffusion,StableVideoDiffusion,1143.2191298083312,1148.6171855419145,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
3 |
+
T2V-Turbo,T2V-Turbo,1092.4551860072625,1093.3461900064547,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
4 |
+
VideoCrafter2,VideoCrafter2,1076.7797371219958,1079.2747502130292,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
5 |
+
AnimateDiff,AnimateDiff,1071.9888858847867,1072.4659107742777,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
6 |
+
CogVideoX,CogVideoX,1046.417835182279,1048.0267833837986,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
7 |
+
LaVie,LaVie,999.6270938177271,1001.6116131699212,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
8 |
+
OpenSora v1.2,OpenSora v1.2,924.0203683794037,903.7581037865372,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
9 |
+
OpenSora,OpenSora,916.0498767986071,917.9017410924956,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
10 |
+
ModelScope,ModelScope,865.3398542588171,868.8554259930636,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
11 |
+
AnimateDiff Turbo,AnimateDiff Turbo,864.1020327407906,866.1422960385084,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
@@ -52502,5 +52502,61 @@
|
|
52502 |
"judge": "arena_user_10.16.18.75",
|
52503 |
"anony": true,
|
52504 |
"tstamp": 1724204524.4511
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
52505 |
}
|
52506 |
]
|
|
|
52502 |
"judge": "arena_user_10.16.18.75",
|
52503 |
"anony": true,
|
52504 |
"tstamp": 1724204524.4511
|
52505 |
+
},
|
52506 |
+
{
|
52507 |
+
"model_a": "FLUX.1-schnell",
|
52508 |
+
"model_b": "FLUX.1-dev",
|
52509 |
+
"winner": "model_b",
|
52510 |
+
"judge": "arena_user_10.16.34.60",
|
52511 |
+
"anony": false,
|
52512 |
+
"tstamp": 1724230659.1573
|
52513 |
+
},
|
52514 |
+
{
|
52515 |
+
"model_a": "PlayGround V2.5",
|
52516 |
+
"model_b": "FLUX.1-schnell",
|
52517 |
+
"winner": "tie",
|
52518 |
+
"judge": "arena_user_10.16.18.162",
|
52519 |
+
"anony": true,
|
52520 |
+
"tstamp": 1724237747.0976
|
52521 |
+
},
|
52522 |
+
{
|
52523 |
+
"model_a": "SDXL-Lightning",
|
52524 |
+
"model_b": "PixArtAlpha",
|
52525 |
+
"winner": "model_b",
|
52526 |
+
"judge": "arena_user_10.16.18.162",
|
52527 |
+
"anony": true,
|
52528 |
+
"tstamp": 1724248013.5766
|
52529 |
+
},
|
52530 |
+
{
|
52531 |
+
"model_a": "AuraFlow",
|
52532 |
+
"model_b": "SDXL-Lightning",
|
52533 |
+
"winner": "model_b",
|
52534 |
+
"judge": "arena_user_10.16.1.165",
|
52535 |
+
"anony": true,
|
52536 |
+
"tstamp": 1724250894.864
|
52537 |
+
},
|
52538 |
+
{
|
52539 |
+
"model_a": "PlayGround V2.5",
|
52540 |
+
"model_b": "FLUX.1-schnell",
|
52541 |
+
"winner": "tie",
|
52542 |
+
"judge": "arena_user_10.16.18.75",
|
52543 |
+
"anony": true,
|
52544 |
+
"tstamp": 1724254894.0143
|
52545 |
+
},
|
52546 |
+
{
|
52547 |
+
"model_a": "PlayGround V2.5",
|
52548 |
+
"model_b": "OpenJourney",
|
52549 |
+
"winner": "tie",
|
52550 |
+
"judge": "arena_user_10.16.18.162",
|
52551 |
+
"anony": true,
|
52552 |
+
"tstamp": 1724254913.5008
|
52553 |
+
},
|
52554 |
+
{
|
52555 |
+
"model_a": "PlayGround V2.5",
|
52556 |
+
"model_b": "AuraFlow",
|
52557 |
+
"winner": "model_a",
|
52558 |
+
"judge": "arena_user_10.16.1.165",
|
52559 |
+
"anony": true,
|
52560 |
+
"tstamp": 1724255141.5267
|
52561 |
}
|
52562 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
@@ -15022,5 +15022,13 @@
|
|
15022 |
"judge": "arena_user_10.16.34.60",
|
15023 |
"anony": true,
|
15024 |
"tstamp": 1724127663.1705
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15025 |
}
|
15026 |
]
|
|
|
15022 |
"judge": "arena_user_10.16.34.60",
|
15023 |
"anony": true,
|
15024 |
"tstamp": 1724127663.1705
|
15025 |
+
},
|
15026 |
+
{
|
15027 |
+
"model_a": "StableVideoDiffusion",
|
15028 |
+
"model_b": "AnimateDiff",
|
15029 |
+
"winner": "model_a",
|
15030 |
+
"judge": "arena_user_10.16.1.165",
|
15031 |
+
"anony": false,
|
15032 |
+
"tstamp": 1724230954.5847
|
15033 |
}
|
15034 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 88247
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cd1660b033bc489c5fbf211b9c528554be5cfcf5135641290ad6a9d7125d7db3
|
3 |
size 88247
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 66377
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:71584f88bde54f52c66f689c8ad20b2bb93c16ed49c295c69016654866ca7157
|
3 |
size 66377
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
@@ -1,18 +1,18 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
PlayGround V2.5,PlayGround V2.5,
|
3 |
-
FLUX.1-dev,FLUX.1-dev,
|
4 |
-
PlayGround V2,PlayGround V2,
|
5 |
-
FLUX.1-schnell,FLUX.1-schnell,
|
6 |
-
HunyuanDiT,HunyuanDiT,
|
7 |
-
StableCascade,StableCascade,
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
SD3,SD3,992.
|
13 |
-
Kolors,Kolors,
|
14 |
-
SDXL,SDXL,968.
|
15 |
-
SDXLTurbo,SDXLTurbo,
|
16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),
|
17 |
-
OpenJourney,OpenJourney,
|
18 |
-
LCM,LCM,
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
PlayGround V2.5,PlayGround V2.5,1133.2628901237126,1133.5940204922306,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
3 |
+
FLUX.1-dev,FLUX.1-dev,1132.2734262471183,1153.2359360195053,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
4 |
+
PlayGround V2,PlayGround V2,1077.6123248465824,1074.9920036115682,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
5 |
+
FLUX.1-schnell,FLUX.1-schnell,1067.2499071169384,1061.3666497454988,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
6 |
+
HunyuanDiT,HunyuanDiT,1054.1087777967914,1039.1876605139332,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
7 |
+
StableCascade,StableCascade,1041.2839169103206,1043.297234391808,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
PixArtAlpha,PixArtAlpha,1028.6598617906304,1017.1043669696825,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
9 |
+
SDXL-Lightning,SDXL-Lightning,1027.899037750196,1030.7742333287965,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
10 |
+
PixArtSigma,PixArtSigma,1022.6398294247064,1021.1258277633667,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
11 |
+
AuraFlow,AuraFlow,1016.4699519667773,1010.5604537602092,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
12 |
+
SD3,SD3,992.874758843956,987.0699372711239,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
Kolors,Kolors,981.9348309085461,977.9500512330701,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
14 |
+
SDXL,SDXL,968.8815288910846,968.0077346632698,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,917.5189860695493,913.4573538053112,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),910.0117686080641,902.462691086812,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,832.7470581402116,825.8362440920455,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,794.5711445648155,806.747578423868,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
@@ -1,11 +1,11 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
StableVideoDiffusion,StableVideoDiffusion,1143.2191298083312,
|
3 |
-
T2V-Turbo,T2V-Turbo,1092.4551860072625,1093.
|
4 |
-
VideoCrafter2,VideoCrafter2,1076.7797371219958,1079.
|
5 |
-
AnimateDiff,AnimateDiff,1071.9888858847867,
|
6 |
-
CogVideoX,CogVideoX,1046.417835182279,1048.
|
7 |
-
LaVie,LaVie,999.6270938177271,1001.
|
8 |
-
OpenSora v1.2,OpenSora v1.2,924.0203683794037,903.
|
9 |
-
OpenSora,OpenSora,916.0498767986071,917.
|
10 |
-
ModelScope,ModelScope,865.3398542588171,868.
|
11 |
-
AnimateDiff Turbo,AnimateDiff Turbo,864.1020327407906,866.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
StableVideoDiffusion,StableVideoDiffusion,1143.2191298083312,1148.6171855419145,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
3 |
+
T2V-Turbo,T2V-Turbo,1092.4551860072625,1093.3461900064547,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
4 |
+
VideoCrafter2,VideoCrafter2,1076.7797371219958,1079.2747502130292,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
5 |
+
AnimateDiff,AnimateDiff,1071.9888858847867,1072.4659107742777,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
6 |
+
CogVideoX,CogVideoX,1046.417835182279,1048.0267833837986,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
7 |
+
LaVie,LaVie,999.6270938177271,1001.6116131699212,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
8 |
+
OpenSora v1.2,OpenSora v1.2,924.0203683794037,903.7581037865372,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
9 |
+
OpenSora,OpenSora,916.0498767986071,917.9017410924956,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
10 |
+
ModelScope,ModelScope,865.3398542588171,868.8554259930636,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
11 |
+
AnimateDiff Turbo,AnimateDiff Turbo,864.1020327407906,866.1422960385084,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|