weichiang commited on
Commit
e107c55
1 Parent(s): 6e4e559

update 1220

Browse files
elo_results_20231220.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd896f0f288e634fd7b349d14b08427c2591a5a099ce1e8366c154ef625ca5d5
3
+ size 44317
leaderboard_table_20231220.csv ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Model,MT-bench (score),Arena Elo rating,MMLU,License,Link
2
+ WizardLM-30B,7.01,-,0.587,Non-commercial,https://huggingface.co/WizardLM/WizardLM-30B-V1.0
3
+ Vicuna-13B-16k,6.92,-,0.545,Llama 2 Community,https://huggingface.co/lmsys/vicuna-13b-v1.5-16k
4
+ WizardLM-13B-v1.1,6.76,-,0.500,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.1
5
+ Tulu-30B,6.43,-,0.581,Non-commercial,https://huggingface.co/allenai/tulu-30b
6
+ Guanaco-65B,6.41,-,0.621,Non-commercial,https://huggingface.co/timdettmers/guanaco-65b-merged
7
+ OpenAssistant-LLaMA-30B,6.41,-,0.560,Non-commercial,https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor
8
+ WizardLM-13B-v1.0,6.35,-,0.523,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.0
9
+ Vicuna-7B-16k,6.22,-,0.485,Llama 2 Community,https://huggingface.co/lmsys/vicuna-7b-v1.5-16k
10
+ Baize-v2-13B,5.75,-,0.489,Non-commercial,https://huggingface.co/project-baize/baize-v2-13b
11
+ XGen-7B-8K-Inst,5.55,-,0.421,Non-commercial,https://huggingface.co/Salesforce/xgen-7b-8k-inst
12
+ Nous-Hermes-13B,5.51,-,0.493,Non-commercial,https://huggingface.co/NousResearch/Nous-Hermes-13b
13
+ MPT-30B-Instruct,5.22,-,0.478,CC-BY-SA 3.0,https://huggingface.co/mosaicml/mpt-30b-instruct
14
+ Falcon-40B-Instruct,5.17,-,0.547,Apache 2.0,https://huggingface.co/tiiuae/falcon-40b-instruct
15
+ H2O-Oasst-OpenLLaMA-13B,4.63,-,0.428,Apache 2.0,https://huggingface.co/h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-13b
16
+ GPT-4-Turbo,9.32,1243,-,Proprietary,https://openai.com/blog/new-models-and-developer-products-announced-at-devday
17
+ GPT-4-0314,8.96,1192,0.864,Proprietary,https://openai.com/research/gpt-4
18
+ Claude-1,7.90,1149,0.770,Proprietary,https://www.anthropic.com/index/introducing-claude
19
+ GPT-4-0613,9.18,1158,-,Proprietary,https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo
20
+ Claude-2.0,8.06,1131,0.785,Proprietary,https://www.anthropic.com/index/claude-2
21
+ Claude-2.1,8.18,1117,-,Proprietary,https://www.anthropic.com/index/claude-2-1
22
+ GPT-3.5-Turbo-0613,8.39,1117,-,Proprietary,https://platform.openai.com/docs/models/gpt-3-5
23
+ Mixtral-8x7b-Instruct-v0.1,8.30,1121,0.706,Apache 2.0,https://mistral.ai/news/mixtral-of-experts/
24
+ Claude-Instant-1,7.85,1110,0.734,Proprietary,https://www.anthropic.com/index/introducing-claude
25
+ GPT-3.5-Turbo-0314,7.94,1105,0.700,Proprietary,https://platform.openai.com/docs/models/gpt-3-5
26
+ Tulu-2-DPO-70B,7.89,1110,-,AI2 ImpACT Low-risk,https://huggingface.co/allenai/tulu-2-dpo-70b
27
+ Yi-34B-Chat,-,1110,0.735,Yi License,https://huggingface.co/01-ai/Yi-34B-Chat
28
+ Gemini Pro,-,1111,0.718,Proprietary,https://blog.google/technology/ai/gemini-api-developers-cloud/
29
+ WizardLM-70B-v1.0,7.71,1102,0.637,Llama 2 Community,https://huggingface.co/WizardLM/WizardLM-70B-V1.0
30
+ Vicuna-33B,7.12,1095,0.592,Non-commercial,https://huggingface.co/lmsys/vicuna-33b-v1.3
31
+ Starling-LM-7B-alpha,8.09,1089,0.639,CC-BY-NC-4.0,https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha
32
+ pplx-70b-online,-,1075,-,Proprietary,https://blog.perplexity.ai/blog/introducing-pplx-online-llms
33
+ OpenChat-3.5,7.81,1077,0.643,Apache-2.0,https://huggingface.co/openchat/openchat_3.5
34
+ OpenHermes-2.5-Mistral-7b,-,1074,-,Apache-2.0,https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B
35
+ GPT-3.5-Turbo-1106,8.32,1074,-,Proprietary,https://platform.openai.com/docs/models/gpt-3-5
36
+ Llama-2-70b-chat,6.86,1077,0.630,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-70b-chat-hf
37
+ SOLAR-10.7B-Instruct-v1.0,7.58,1062,0.662,CC-BY-NC-4.0,https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0
38
+ Dolphin-2.2.1-Mistral-7B,-,1059,-,Apache-2.0,https://huggingface.co/ehartford/dolphin-2.2.1-mistral-7b
39
+ WizardLM-13b-v1.2,7.20,1057,0.527,Llama 2 Community,https://huggingface.co/WizardLM/WizardLM-13B-V1.2
40
+ Zephyr-7b-beta,7.34,1049,0.614,MIT,https://huggingface.co/HuggingFaceH4/zephyr-7b-beta
41
+ MPT-30B-chat,6.39,1042,0.504,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-30b-chat
42
+ Vicuna-13B,6.57,1041,0.558,Llama 2 Community,https://huggingface.co/lmsys/vicuna-13b-v1.5
43
+ QWen-Chat-14B,6.96,1041,0.665,Qianwen LICENSE,https://huggingface.co/Qwen/Qwen-14B-Chat
44
+ Zephyr-7b-alpha,6.88,1038,-,MIT,https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha
45
+ CodeLlama-34B-instruct,-,1039,0.537,Llama 2 Community,https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf
46
+ falcon-180b-chat,-,1035,0.680,Falcon-180B TII License,https://huggingface.co/tiiuae/falcon-180B-chat
47
+ Guanaco-33B,6.53,1031,0.576,Non-commercial,https://huggingface.co/timdettmers/guanaco-33b-merged
48
+ Llama-2-13b-chat,6.65,1033,0.536,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-13b-chat-hf
49
+ Mistral-7B-Instruct-v0.1,6.84,1023,0.554,Apache 2.0,https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1
50
+ pplx-7b-online,-,1033,-,Proprietary,https://blog.perplexity.ai/blog/introducing-pplx-online-llms
51
+ Llama-2-7b-chat,6.27,1016,0.458,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
52
+ Vicuna-7B,6.17,1004,0.498,Llama 2 Community,https://huggingface.co/lmsys/vicuna-7b-v1.5
53
+ PaLM-Chat-Bison-001,6.40,1004,-,Proprietary,https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models#foundation_models
54
+ Koala-13B,5.35,965,0.447,Non-commercial,https://bair.berkeley.edu/blog/2023/04/03/koala/
55
+ ChatGLM3-6B,-,959,-,Apache-2.0,https://huggingface.co/THUDM/chatglm3-6b
56
+ GPT4All-13B-Snoozy,5.41,937,0.430,Non-commercial,https://huggingface.co/nomic-ai/gpt4all-13b-snoozy
57
+ MPT-7B-Chat,5.42,930,0.320,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-7b-chat
58
+ ChatGLM2-6B,4.96,928,0.455,Apache-2.0,https://huggingface.co/THUDM/chatglm2-6b
59
+ RWKV-4-Raven-14B,3.98,924,0.256,Apache 2.0,https://huggingface.co/BlinkDL/rwkv-4-raven
60
+ Alpaca-13B,4.53,904,0.481,Non-commercial,https://crfm.stanford.edu/2023/03/13/alpaca.html
61
+ OpenAssistant-Pythia-12B,4.32,896,0.270,Apache 2.0,https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5
62
+ ChatGLM-6B,4.50,882,0.361,Non-commercial,https://huggingface.co/THUDM/chatglm-6b
63
+ FastChat-T5-3B,3.04,873,0.477,Apache 2.0,https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
64
+ StableLM-Tuned-Alpha-7B,2.75,844,0.244,CC-BY-NC-SA-4.0,https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b
65
+ Dolly-V2-12B,3.28,822,0.257,MIT,https://huggingface.co/databricks/dolly-v2-12b
66
+ LLaMA-13B,2.61,800,0.470,Non-commercial,https://arxiv.org/abs/2302.13971