lmzheng commited on
Commit
5604bf6
1 Parent(s): 703935b

Upload 2 files

Browse files
elo_results_20230802.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2918cd54236776fd0f05ae1ad858297159fb46298b32af19f2b1ee4310baa40e
3
+ size 37078
leaderboard_table_20230802.csv CHANGED
@@ -1,39 +1,41 @@
1
  Model,MT-bench (score),Arena Elo rating,MMLU,License,Link
2
- GPT-4,8.99,1210,0.864,Proprietary,https://openai.com/research/gpt-4
3
- Claude-2,8.06,1142,0.785,Proprietary,https://www.anthropic.com/index/claude-2
4
- GPT-3.5-turbo,7.94,1124,0.700,Proprietary,https://openai.com/blog/chatgpt
5
- Claude-1,7.90,1167,0.770,Proprietary,https://www.anthropic.com/index/introducing-claude
6
- Claude-instant-1,7.85,1140,0.734,Proprietary,https://www.anthropic.com/index/introducing-claude
7
- Vicuna-33B,7.12,1097,0.592,Non-commercial,https://huggingface.co/lmsys/vicuna-33b-v1.3
8
  WizardLM-30B,7.01,-,0.587,Non-commercial,https://huggingface.co/WizardLM/WizardLM-30B-V1.0
9
- Llama-2-70b-chat,6.86,-,0.630,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-70b-hf
10
- WizardLM-13B-v1.1,6.76,1039,0.500,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.1
11
- Llama-2-13b-chat,6.65,989,0.536,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-13b-hf
12
- Vicuna-13B,6.57,1052,0.558,Llama 2 Community,https://huggingface.co/lmsys/vicuna-13b-v1.5
13
- Guanaco-33B,6.53,1039,0.576,Non-commercial,https://huggingface.co/timdettmers/guanaco-33b-merged
 
14
  Tulu-30B,6.43,-,0.581,Non-commercial,https://huggingface.co/allenai/tulu-30b
15
  Guanaco-65B,6.41,-,0.621,Non-commercial,https://huggingface.co/timdettmers/guanaco-65b-merged
16
  OpenAssistant-LLaMA-30B,6.41,-,0.560,Non-commercial,https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor
17
  PaLM-Chat-Bison-001,6.40,1015,-,Proprietary,https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models#foundation_models
18
- MPT-30B-chat,6.39,1052,0.504,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-30b-chat
19
- WizardLM-13B,6.35,,0.523,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.0
20
- Llama-2-7b-chat,6.27,970,0.458,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
21
- Vicuna-7B,6.17,1001,0.498,Llama 2 Community,https://huggingface.co/lmsys/vicuna-7b-v1.5
 
22
  Baize-v2-13B,5.75,-,0.489,Non-commercial,https://huggingface.co/project-baize/baize-v2-13b
23
  XGen-7B-8K-Inst,5.55,-,0.421,Non-commercial,https://huggingface.co/Salesforce/xgen-7b-8k-inst
24
  Nous-Hermes-13B,5.51,-,0.493,Non-commercial,https://huggingface.co/NousResearch/Nous-Hermes-13b
25
- MPT-7B-Chat,5.42,943,0.320,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-7b-chat
26
- GPT4All-13B-Snoozy,5.41,964,0.430,Non-commercial,https://huggingface.co/nomic-ai/gpt4all-13b-snoozy
27
- Koala-13B,5.35,981,0.447,Non-commercial,https://bair.berkeley.edu/blog/2023/04/03/koala/
28
  MPT-30B-Instruct,5.22,-,0.478,CC-BY-SA 3.0,https://huggingface.co/mosaicml/mpt-30b-instruct
29
  Falcon-40B-Instruct,5.17,-,0.547,Apache 2.0,https://huggingface.co/tiiuae/falcon-40b-instruct
30
  ChatGLM2-6B,4.96,-,0.455,Apache-2.0,https://huggingface.co/THUDM/chatglm2-6b
31
  H2O-Oasst-OpenLLaMA-13B,4.63,-,0.428,Apache 2.0,https://huggingface.co/h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-13b
32
- Alpaca-13B,4.53,920,0.481,Non-commercial,https://crfm.stanford.edu/2023/03/13/alpaca.html
33
- ChatGLM-6B,4.50,899,0.361,Non-commercial,https://huggingface.co/THUDM/chatglm-6b
34
- OpenAssistant-Pythia-12B,4.32,914,0.270,Apache 2.0,https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5
35
- RWKV-4-Raven-14B,3.98,939,0.256,Apache 2.0,https://huggingface.co/BlinkDL/rwkv-4-raven
36
- Dolly-V2-12B,3.28,840,0.257,MIT,https://huggingface.co/databricks/dolly-v2-12b
37
- FastChat-T5-3B,3.04,890,0.477,Apache 2.0,https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
38
- StableLM-Tuned-Alpha-7B,2.75,861,0.244,CC-BY-NC-SA-4.0,https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b
39
- LLaMA-13B,2.61,815,0.470,Non-commercial,https://arxiv.org/abs/2302.13971
 
1
  Model,MT-bench (score),Arena Elo rating,MMLU,License,Link
2
+ GPT-4,8.99,1206,0.864,Proprietary,https://openai.com/research/gpt-4
3
+ Claude-2,8.06,1135,0.785,Proprietary,https://www.anthropic.com/index/claude-2
4
+ GPT-3.5-turbo,7.94,1122,0.700,Proprietary,https://openai.com/blog/chatgpt
5
+ Claude-1,7.90,1166,0.770,Proprietary,https://www.anthropic.com/index/introducing-claude
6
+ Claude-instant-1,7.85,1138,0.734,Proprietary,https://www.anthropic.com/index/introducing-claude
7
+ Vicuna-33B,7.12,1096,0.592,Non-commercial,https://huggingface.co/lmsys/vicuna-33b-v1.3
8
  WizardLM-30B,7.01,-,0.587,Non-commercial,https://huggingface.co/WizardLM/WizardLM-30B-V1.0
9
+ Vicuna-13B-16k,6.87,-,0.541,Llama 2 Community,https://huggingface.co/lmsys/vicuna-13b-v1.5-16k
10
+ Llama-2-70b-chat,6.86,-,0.630,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-70b-chat-hf
11
+ WizardLM-13B-v1.1,6.76,1040,0.500,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.1
12
+ Llama-2-13b-chat,6.65,987,0.536,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-13b-chat-hf
13
+ Vicuna-13B,6.57,1051,0.558,Llama 2 Community,https://huggingface.co/lmsys/vicuna-13b-v1.5
14
+ Guanaco-33B,6.53,1038,0.576,Non-commercial,https://huggingface.co/timdettmers/guanaco-33b-merged
15
  Tulu-30B,6.43,-,0.581,Non-commercial,https://huggingface.co/allenai/tulu-30b
16
  Guanaco-65B,6.41,-,0.621,Non-commercial,https://huggingface.co/timdettmers/guanaco-65b-merged
17
  OpenAssistant-LLaMA-30B,6.41,-,0.560,Non-commercial,https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor
18
  PaLM-Chat-Bison-001,6.40,1015,-,Proprietary,https://cloud.google.com/vertex-ai/docs/generative-ai/learn/models#foundation_models
19
+ MPT-30B-chat,6.39,1046,0.504,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-30b-chat
20
+ WizardLM-13B,6.35,-,0.523,Non-commercial,https://huggingface.co/WizardLM/WizardLM-13B-V1.0
21
+ Llama-2-7b-chat,6.27,961,0.458,Llama 2 Community,https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
22
+ Vicuna-7B-16k,6.22,-,0.485,Llama 2 Community,https://huggingface.co/lmsys/vicuna-7b-v1.5-16k
23
+ Vicuna-7B,6.17,1006,0.498,Llama 2 Community,https://huggingface.co/lmsys/vicuna-7b-v1.5
24
  Baize-v2-13B,5.75,-,0.489,Non-commercial,https://huggingface.co/project-baize/baize-v2-13b
25
  XGen-7B-8K-Inst,5.55,-,0.421,Non-commercial,https://huggingface.co/Salesforce/xgen-7b-8k-inst
26
  Nous-Hermes-13B,5.51,-,0.493,Non-commercial,https://huggingface.co/NousResearch/Nous-Hermes-13b
27
+ MPT-7B-Chat,5.42,947,0.320,CC-BY-NC-SA-4.0,https://huggingface.co/mosaicml/mpt-7b-chat
28
+ GPT4All-13B-Snoozy,5.41,967,0.430,Non-commercial,https://huggingface.co/nomic-ai/gpt4all-13b-snoozy
29
+ Koala-13B,5.35,983,0.447,Non-commercial,https://bair.berkeley.edu/blog/2023/04/03/koala/
30
  MPT-30B-Instruct,5.22,-,0.478,CC-BY-SA 3.0,https://huggingface.co/mosaicml/mpt-30b-instruct
31
  Falcon-40B-Instruct,5.17,-,0.547,Apache 2.0,https://huggingface.co/tiiuae/falcon-40b-instruct
32
  ChatGLM2-6B,4.96,-,0.455,Apache-2.0,https://huggingface.co/THUDM/chatglm2-6b
33
  H2O-Oasst-OpenLLaMA-13B,4.63,-,0.428,Apache 2.0,https://huggingface.co/h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-13b
34
+ Alpaca-13B,4.53,923,0.481,Non-commercial,https://crfm.stanford.edu/2023/03/13/alpaca.html
35
+ ChatGLM-6B,4.50,900,0.361,Non-commercial,https://huggingface.co/THUDM/chatglm-6b
36
+ OpenAssistant-Pythia-12B,4.32,915,0.270,Apache 2.0,https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5
37
+ RWKV-4-Raven-14B,3.98,943,0.256,Apache 2.0,https://huggingface.co/BlinkDL/rwkv-4-raven
38
+ Dolly-V2-12B,3.28,842,0.257,MIT,https://huggingface.co/databricks/dolly-v2-12b
39
+ FastChat-T5-3B,3.04,892,0.477,Apache 2.0,https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
40
+ StableLM-Tuned-Alpha-7B,2.75,863,0.244,CC-BY-NC-SA-4.0,https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b
41
+ LLaMA-13B,2.61,817,0.470,Non-commercial,https://arxiv.org/abs/2302.13971