mihaimasala commited on
Commit
5341864
·
verified ·
1 Parent(s): f5ad06c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -1
README.md CHANGED
@@ -3,6 +3,22 @@ license: llama2
3
  language:
4
  - ro
5
  base_model: meta-llama/Llama-2-7b-hf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  ---
7
 
8
  # Model Card for Model ID
@@ -65,13 +81,20 @@ outputs = model.generate(**input_ids, max_new_tokens=100)
65
  print(tokenizer.decode(outputs[0]))
66
  ```
67
 
68
- ## Benchmarks
69
 
70
  | Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
71
  |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
72
  | Llama-2-7b | 37.04 | 36.05 | **33.66** | 57.56 | 48.00 | **4.75** | 42.22 |
73
  | *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
74
 
 
 
 
 
 
 
 
75
 
76
 
77
  ## RoLlama2 Model Family
 
3
  language:
4
  - ro
5
  base_model: meta-llama/Llama-2-7b-hf
6
+ model-index:
7
+ - name: OpenLLM-Ro/RoLlama2-7b-Base
8
+ results:
9
+ - task:
10
+ type: text-generation
11
+ dataset:
12
+ name: ai2_arc
13
+ type: ai2_arc
14
+ metrics:
15
+ - name: AI2 Reasoning Challenge (25-Shot)
16
+ type: AI2 Reasoning Challenge (25-Shot)
17
+ value: 64.59
18
+ source:
19
+ name: Open LLM Leaderboard
20
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
21
+
22
  ---
23
 
24
  # Model Card for Model ID
 
81
  print(tokenizer.decode(outputs[0]))
82
  ```
83
 
84
+ ## Academic Benchmarks
85
 
86
  | Model | Average | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
87
  |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
88
  | Llama-2-7b | 37.04 | 36.05 | **33.66** | 57.56 | 48.00 | **4.75** | 42.22 |
89
  | *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
90
 
91
+ <!-- ## Downstream Tasks
92
+
93
+ | Model | Sentiment Analysis | ARC | MMLU |Winogrande|HellaSwag | GSM8k |TruthfulQA|
94
+ |--------------------|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|:--------:|
95
+ | Llama-2-7b | 37.04 | 36.05 | **33.66** | 57.56 | 48.00 | **4.75** | 42.22 |
96
+ | *RoLlama2-7b-Base* | ***38.03*** | ***37.95*** | *27.22* | ***59.29*** | ***57.22*** | *2.53* | ***44.00*** |
97
+ -->
98
 
99
 
100
  ## RoLlama2 Model Family