Adding Evaluation Results

#9
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -50,4 +50,17 @@ See more details in the "Training Details of Vicuna Models" section in the appen
50
  Vicuna is evaluated with standard benchmarks, human preference, and LLM-as-a-judge. See more details in this [paper](https://arxiv.org/pdf/2306.05685.pdf) and [leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard).
51
 
52
  ## Difference between different versions of Vicuna
53
- See [vicuna_weights_version.md](https://github.com/lm-sys/FastChat/blob/main/docs/vicuna_weights_version.md)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  Vicuna is evaluated with standard benchmarks, human preference, and LLM-as-a-judge. See more details in this [paper](https://arxiv.org/pdf/2306.05685.pdf) and [leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard).
51
 
52
  ## Difference between different versions of Vicuna
53
+ See [vicuna_weights_version.md](https://github.com/lm-sys/FastChat/blob/main/docs/vicuna_weights_version.md)
54
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
55
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_lmsys__vicuna-13b-delta-v1.1)
56
+
57
+ | Metric | Value |
58
+ |-----------------------|---------------------------|
59
+ | Avg. | 47.0 |
60
+ | ARC (25-shot) | 52.73 |
61
+ | HellaSwag (10-shot) | 80.14 |
62
+ | MMLU (5-shot) | 51.9 |
63
+ | TruthfulQA (0-shot) | 52.08 |
64
+ | Winogrande (5-shot) | 74.19 |
65
+ | GSM8K (5-shot) | 8.64 |
66
+ | DROP (3-shot) | 9.31 |