mihaimasala commited on
Commit
f864b76
1 Parent(s): d4abe85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -14
README.md CHANGED
@@ -31,7 +31,7 @@ OpenLLM represents the first open-source effort to build a LLM specialized for R
31
  <!-- Provide the basic links for the model. -->
32
 
33
  - **Repository:** https://github.com/OpenLLM-Ro/llama-recipes
34
- - **Paper:** https://arxiv.org/abs/2405.07703
35
 
36
  ## Intended Use
37
 
@@ -68,19 +68,8 @@ print(tokenizer.decode(outputs[0]))
68
 
69
  | Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
70
  |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
71
- | Llama-2-7b | 35.65 | 33.85 | 30.93 | 56.43 | 46.98 | 1.37 | 44.36 |
72
- | *RoLlama2-7b-Base* | *38.32* | *35.83* | *30.47* | *60.16* | *55.52* | *2.17* | *45.78* |
73
- | Llama-2-7b-chat | 35.58 | 34.92 | 32.37 | 54.26 | 44.52 | 2.05 | 45.38 |
74
- |RoLlama2-7b-Instruct| **44.42**|**40.36** |**37.41** |**69.58** | 55.64 | **17.59**| 45.96 |
75
- |RoLlama2-7b-Chat | 42.65 | 38.29 | 35.27 | 65.25 | **56.45**| 12.84 | **47.79**|
76
-
77
- ## MT-Bench
78
-
79
- | Model | Average | 1st turn | 2nd turn |
80
- |--------------------|:--------:|:--------:|:--------:|
81
- | Llama-2-7b-chat | 1.70 | 2.00 | 1.41 |
82
- |RoLlama2-7b-Instruct| **4.31**|**5.66** | 2.95 |
83
- |RoLlama2-7b-Chat | 3.91 | 4.25 | **3.57** |
84
 
85
 
86
 
 
31
  <!-- Provide the basic links for the model. -->
32
 
33
  - **Repository:** https://github.com/OpenLLM-Ro/llama-recipes
34
+ - **Paper:** https://arxiv.org/abs/2406.18266
35
 
36
  ## Intended Use
37
 
 
68
 
69
  | Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
70
  |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
71
+ | Llama-2-7b | 37.11 | 36.09 | **33.67** | 57.60 | 48.00 | **5.08** | 42.23 |
72
+ | *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
 
 
 
 
 
 
 
 
 
 
 
73
 
74
 
75