mihaimasala
commited on
Commit
•
f864b76
1
Parent(s):
d4abe85
Update README.md
Browse files
README.md
CHANGED
@@ -31,7 +31,7 @@ OpenLLM represents the first open-source effort to build a LLM specialized for R
|
|
31 |
<!-- Provide the basic links for the model. -->
|
32 |
|
33 |
- **Repository:** https://github.com/OpenLLM-Ro/llama-recipes
|
34 |
-
- **Paper:** https://arxiv.org/abs/
|
35 |
|
36 |
## Intended Use
|
37 |
|
@@ -68,19 +68,8 @@ print(tokenizer.decode(outputs[0]))
|
|
68 |
|
69 |
| Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
|
70 |
|--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
|
71 |
-
| Llama-2-7b |
|
72 |
-
| *RoLlama2-7b-Base* |
|
73 |
-
| Llama-2-7b-chat | 35.58 | 34.92 | 32.37 | 54.26 | 44.52 | 2.05 | 45.38 |
|
74 |
-
|RoLlama2-7b-Instruct| **44.42**|**40.36** |**37.41** |**69.58** | 55.64 | **17.59**| 45.96 |
|
75 |
-
|RoLlama2-7b-Chat | 42.65 | 38.29 | 35.27 | 65.25 | **56.45**| 12.84 | **47.79**|
|
76 |
-
|
77 |
-
## MT-Bench
|
78 |
-
|
79 |
-
| Model | Average | 1st turn | 2nd turn |
|
80 |
-
|--------------------|:--------:|:--------:|:--------:|
|
81 |
-
| Llama-2-7b-chat | 1.70 | 2.00 | 1.41 |
|
82 |
-
|RoLlama2-7b-Instruct| **4.31**|**5.66** | 2.95 |
|
83 |
-
|RoLlama2-7b-Chat | 3.91 | 4.25 | **3.57** |
|
84 |
|
85 |
|
86 |
|
|
|
31 |
<!-- Provide the basic links for the model. -->
|
32 |
|
33 |
- **Repository:** https://github.com/OpenLLM-Ro/llama-recipes
|
34 |
+
- **Paper:** https://arxiv.org/abs/2406.18266
|
35 |
|
36 |
## Intended Use
|
37 |
|
|
|
68 |
|
69 |
| Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
|
70 |
|--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
|
71 |
+
| Llama-2-7b | 37.11 | 36.09 | **33.67** | 57.60 | 48.00 | **5.08** | 42.23 |
|
72 |
+
| *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
73 |
|
74 |
|
75 |
|