Model,MT-bench (win rate %),MT-bench (score),Arena Elo rating,MMLU,License,Link
GPT-4,69.38%,8.99,1227,0.864,Proprietary,https://openai.com/research/gpt-4
GPT-3.5-turbo,-,7.94,1130,0.700,Proprietary,https://openai.com/blog/chatgpt
Claude-v1,46.88%,7.90,1178,0.756,Proprietary,https://www.anthropic.com/index/introducing-claude
Claude-instant-v1,40.00%,7.85,1156,0.613,Proprietary,https://www.anthropic.com/index/introducing-claude
Vicuna-33B,43.75%,7.12,-,0.592,Non-commercial,https://huggingface.co/lmsys/vicuna-33b-v1.3
WizardLM-30B,23.13%,7.01,-,0.587,Non-commercial,https://huggingface.co/WizardLM/WizardLM-30B-V1.0
Guanaco-33B,26.25%,6.53,1065,0.576,Non-commercial,https://huggingface.co/timdettmers/guanaco-33b-merged
Tulu-30B,18.13%,6.43,-,0.581,Non-commercial,https://huggingface.co/allenai/tulu-30b
Guanaco-65B,23.75%,6.41,-,0.621,Non-commercial,https://huggingface.co/timdettmers/guanaco-65b-merged
OpenAssistant-LLaMA-30B,14.38%,6.41,-,0.560,Non-commercial,https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor
PaLM-Chat-Bison-001,11.25%,6.40,1038,-,Proprietary,https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models#foundation_models
Vicuna-13B,20.63%,6.39,1061,0.521,Non-commercial,https://huggingface.co/lmsys/vicuna-13b-v1.3
MPT-30B-chat,18.13%,6.39,-,0.504,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-30b-chat
WizardLM-13B,16.88%,6.35,1048,0.523,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.0
Vicuna-7B,18.75%,6.00,1008,0.471,Non-commercial,https://huggingface.co/lmsys/vicuna-7b-v1.3
Baize-v2-13B,13.13%,5.75,-,0.489,Non-commercial,https://huggingface.co/project-baize/baize-v2-13b
Nous-Hermes-13B,7.50%,5.51,-,0.493,Non-commercial,https://huggingface.co/NousResearch/Nous-Hermes-13b
MPT-7B-Chat,6.25%,5.42,956,0.320,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-7b-chat
GPT4All-13B-Snoozy,8.75%,5.41,986,0.430,Non-commercial,https://huggingface.co/nomic-ai/gpt4all-13b-snoozy
Koala-13B,6.25%,5.35,992,0.447,Non-commercial,https://bair.berkeley.edu/blog/2023/04/03/koala/
MPT-30B-Instruct,4.38%,5.22,-,0.478,CC-BY-SA 3.0,https://huggingface.co/mosaicml/mpt-30b-instruct
Falcon-40B-Instruct,6.25%,5.17,-,0.547,Apache 2.0,https://huggingface.co/tiiuae/falcon-40b-instruct
H2O-Oasst-OpenLLaMA-13B,11.88%,4.63,-,0.428,Apache 2.0,https://huggingface.co/h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-13b
Alpaca-13B,5.00%,4.53,930,0.481,Non-commercial,https://crfm.stanford.edu/2023/03/13/alpaca.html
ChatGLM-6B,3.75%,4.50,905,0.361,Non-commercial,https://huggingface.co/THUDM/chatglm-6b
OpenAssistant-Pythia-12B,5.00%,4.32,924,0.270,Apache 2.0,https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5
RWKV-4-Raven-14B,3.75%,3.98,950,0.256,Apache 2.0,https://huggingface.co/BlinkDL/rwkv-4-raven
Dolly-V2-12B,3.13%,3.28,850,0.257,MIT,https://huggingface.co/databricks/dolly-v2-12b
FastChat-T5-3B,3.13%,3.04,897,0.477,Apache 2.0,https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
StableLM-Tuned-Alpha-7B,0.63%,2.75,871,0.244,CC-BY-NC-SA-4.0,https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b
LLaMA-13B,1.88%,2.61,826,0.470,Non-commercial,https://arxiv.org/abs/2302.13971