leaderboard-pt-pr-bot commited on
Commit
7d9f9d2
1 Parent(s): 9d130f5

Fixing some errors of the leaderboard evaluation results in the ModelCard yaml

Browse files

The name of a few benchmarks are incorrect on the model metadata. This commit fixes some minor errors of the [last PR](6) on the ModelCard YAML metadata.

Files changed (1) hide show
  1. README.md +28 -2
README.md CHANGED
@@ -8,9 +8,9 @@ tags:
8
  - analytics
9
  - analise-dados
10
  - portugues-BR
11
- base_model: codellama/CodeLlama-7b-Instruct-hf
12
  datasets:
13
  - semantixai/Test-Dataset-Lloro
 
14
  model-index:
15
  - name: LloroV2
16
  results:
@@ -75,6 +75,19 @@ model-index:
75
  - type: f1_macro
76
  value: 57.19
77
  name: f1-macro
 
 
 
 
 
 
 
 
 
 
 
 
 
78
  - type: pearson
79
  value: 26.81
80
  name: pearson
@@ -102,7 +115,7 @@ model-index:
102
  name: Text Generation
103
  dataset:
104
  name: HateBR Binary
105
- type: eduagarcia/portuguese_benchmark
106
  split: test
107
  args:
108
  num_few_shot: 25
@@ -110,6 +123,19 @@ model-index:
110
  - type: f1_macro
111
  value: 68.02
112
  name: f1-macro
 
 
 
 
 
 
 
 
 
 
 
 
 
113
  - type: f1_macro
114
  value: 38.53
115
  name: f1-macro
 
8
  - analytics
9
  - analise-dados
10
  - portugues-BR
 
11
  datasets:
12
  - semantixai/Test-Dataset-Lloro
13
+ base_model: codellama/CodeLlama-7b-Instruct-hf
14
  model-index:
15
  - name: LloroV2
16
  results:
 
75
  - type: f1_macro
76
  value: 57.19
77
  name: f1-macro
78
+ source:
79
+ url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=semantixai/LloroV2
80
+ name: Open Portuguese LLM Leaderboard
81
+ - task:
82
+ type: text-generation
83
+ name: Text Generation
84
+ dataset:
85
+ name: Assin2 STS
86
+ type: eduagarcia/portuguese_benchmark
87
+ split: test
88
+ args:
89
+ num_few_shot: 15
90
+ metrics:
91
  - type: pearson
92
  value: 26.81
93
  name: pearson
 
115
  name: Text Generation
116
  dataset:
117
  name: HateBR Binary
118
+ type: ruanchaves/hatebr
119
  split: test
120
  args:
121
  num_few_shot: 25
 
123
  - type: f1_macro
124
  value: 68.02
125
  name: f1-macro
126
+ source:
127
+ url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=semantixai/LloroV2
128
+ name: Open Portuguese LLM Leaderboard
129
+ - task:
130
+ type: text-generation
131
+ name: Text Generation
132
+ dataset:
133
+ name: PT Hate Speech Binary
134
+ type: hate_speech_portuguese
135
+ split: test
136
+ args:
137
+ num_few_shot: 25
138
+ metrics:
139
  - type: f1_macro
140
  value: 38.53
141
  name: f1-macro