mihaimasala
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -3,6 +3,22 @@ license: llama2
|
|
3 |
language:
|
4 |
- ro
|
5 |
base_model: meta-llama/Llama-2-7b-hf
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
6 |
---
|
7 |
|
8 |
# Model Card for Model ID
|
@@ -65,13 +81,20 @@ outputs = model.generate(**input_ids, max_new_tokens=100)
|
|
65 |
print(tokenizer.decode(outputs[0]))
|
66 |
```
|
67 |
|
68 |
-
## Benchmarks
|
69 |
|
70 |
| Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
|
71 |
|--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
|
72 |
| Llama-2-7b | 37.04 | 36.05 | **33.66** | 57.56 | 48.00 | **4.75** | 42.22 |
|
73 |
| *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
|
74 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
75 |
|
76 |
|
77 |
## RoLlama2 Model Family
|
|
|
3 |
language:
|
4 |
- ro
|
5 |
base_model: meta-llama/Llama-2-7b-hf
|
6 |
+
model-index:
|
7 |
+
- name: OpenLLM-Ro/RoLlama2-7b-Base
|
8 |
+
results:
|
9 |
+
- task:
|
10 |
+
type: text-generation
|
11 |
+
dataset:
|
12 |
+
name: ai2_arc
|
13 |
+
type: ai2_arc
|
14 |
+
metrics:
|
15 |
+
- name: AI2 Reasoning Challenge (25-Shot)
|
16 |
+
type: AI2 Reasoning Challenge (25-Shot)
|
17 |
+
value: 64.59
|
18 |
+
source:
|
19 |
+
name: Open LLM Leaderboard
|
20 |
+
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
|
21 |
+
|
22 |
---
|
23 |
|
24 |
# Model Card for Model ID
|
|
|
81 |
print(tokenizer.decode(outputs[0]))
|
82 |
```
|
83 |
|
84 |
+
## Academic Benchmarks
|
85 |
|
86 |
| Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
|
87 |
|--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
|
88 |
| Llama-2-7b | 37.04 | 36.05 | **33.66** | 57.56 | 48.00 | **4.75** | 42.22 |
|
89 |
| *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
|
90 |
|
91 |
+
<!-- ## Downstream Tasks
|
92 |
+
|
93 |
+
| Model | Sentiment Analysis | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
|
94 |
+
|--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
|
95 |
+
| Llama-2-7b | 37.04 | 36.05 | **33.66** | 57.56 | 48.00 | **4.75** | 42.22 |
|
96 |
+
| *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
|
97 |
+
-->
|
98 |
|
99 |
|
100 |
## RoLlama2 Model Family
|