File size: 848 Bytes
2604091 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
Category Model Elo matches Win vs. Reference (w/ # ratings)
Single Image Human Verified GPT-4 Reference 1370 5442 -
Single Image LLaVA (13B) 1106 5446 17.81% (n=494)
Single Image LlamaAdapter-v2 (7B) 1082 5445 13.75% (n=502)
Single Image mPLUG-Owl (7B) 1081 5452 15.29% (n=497)
Single Image InstructBLIP (13B) 1011 5444 13.73% (n=517)
Single Image Otter (9B) 991 5450 6.84% (n=512)
Single Image VisualGPT (Da Vinci 003) 972 5445 1.52% (n=527)
Single Image MiniGPT-4 (7B) 921 5442 3.26% (n=522)
Single Image OpenFlamingo (9B) 877 5449 2.86% (n=524)
Single Image PandaGPT (13B) 826 5441 2.63% (n=533)
Single Image Multimodal GPT 763 5450 0.18% (n=544)
Multiple Images Human Verified GPT-4 Reference 1192 180 -
Multiple Images mPLUG-Owl 995 180 6.67% (n=60)
Multiple Images Otter 911 180 1.69% (n=59)
Multiple Images OpenFlamingo 902 180 1.67% (n=60) |