Hugging Face's logo

mbruton
/
spa_en_XLM-R

Token Classification
Transformers
PyTorch
Spanish
English
xlm-roberta
Inference Endpoints
Model card Files Community
mbruton commited on
Commit
95520dd
•
1 Parent(s): 3d053de

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +397 -0
README.md ADDED
@@ -0,0 +1,397 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - mbruton/spanish_srl
5
+ - CoNLL-2012
6
+ language:
7
+ - es
8
+ - en
9
+ metrics:
10
+ - seqeval
11
+ library_name: transformers
12
+ pipeline_tag: token-classification
13
+ ---
14
+
15
+ # Model Card for SpaXLM-R-en for Semantic Role Labeling
16
+
17
+ This model is fine-tuned on a version of [XLM RoBERTa Base](https://huggingface.co/xlm-roberta-base) which is pre-trained on the SRL task for English, and is one of 24 models introduced as part of [this project](https://github.com/mbruton0426/GalicianSRL).
18
+
19
+ ## Model Details
20
+
21
+ ### Model Description
22
+
23
+ SpaXLM-R-en for Semantic Role Labeling (SRL) is a transformers model, leveraging XLM-R's extensive pretraining on 100 languages to achieve better SRL predictions for Spanish. This model is additionally pre-trained on the SRL task for English. It was fine-tuned on Spanish with the following objectives:
24
+
25
+ - Identify up to 16 verbal roots within a sentence.
26
+ - Identify available arguments and thematic roles for each verbal root.
27
+
28
+ Labels are formatted as: r#:tag, where r# links the token to a specific verbal root of index #, and tag identifies the token as the verbal root (root) or an individual argument (arg0/arg1/arg2/arg3/argM) and its thematic role (adv/agt/atr/ben/cau/cot/des/efi/ein/exp/ext/fin/ins/loc/mnr/ori/pat/src/tem/tmp)
29
+
30
+ - **Developed by:** [Micaella Bruton](mailto:micaellabruton@gmail.com)
31
+ - **Model type:** Transformers
32
+ - **Language(s) (NLP):** Spanish (es), English (en), Portuguese (pt)
33
+ - **License:** Apache 2.0
34
+ - **Finetuned from model:** [English pre-trained XLM RoBERTa Base](https://huggingface.co/liaad/srl-en_xlmr-base)
35
+
36
+ ### Model Sources
37
+
38
+ - **Repository:** [GalicianSRL](https://github.com/mbruton0426/GalicianSRL)
39
+ - **Paper:** To be updated
40
+
41
+ ## Uses
42
+
43
+ This model is intended to be used to develop and improve natural language processing tools for Spanish.
44
+
45
+ ## Bias, Risks, and Limitations
46
+
47
+ The Spanish training set lacked highly complex sentences and as such, performs much better on sentences of mid- to low-complexity.
48
+
49
+ ## Training Details
50
+
51
+ ### Training Data
52
+
53
+ This model was pre-trained on the [OntoNotes 5.0 English SRL corpus](http://catalog.ldc.upenn.edu/LDC2013T19).
54
+ This model was fine-tuned on the "train" portion of the [SpanishSRL Dataset](https://huggingface.co/datasets/mbruton/spanish_srl) produced as part of this same project.
55
+
56
+ #### Training Hyperparameters
57
+
58
+ - **Learning Rate:** 2e-5
59
+ - **Batch Size:** 16
60
+ - **Weight Decay:** 0.01
61
+ - **Early Stopping:** 10 epochs
62
+
63
+ ## Evaluation
64
+
65
+ #### Testing Data
66
+
67
+ This model was tested on the "test" portion of the [SpanishSRL Dataset](https://huggingface.co/datasets/mbruton/spanish_srl) produced as part of this same project.
68
+
69
+ #### Metrics
70
+
71
+ [seqeval](https://huggingface.co/spaces/evaluate-metric/seqeval) is a Python framework for sequence labeling evaluation. It can evaluate the performance of chunking tasks such as named-entity recognition, part-of-speech tagging, and semantic role labeling.
72
+ It supplies scoring both overall and per label type.
73
+
74
+ Overall:
75
+ - `accuracy`: the average [accuracy](https://huggingface.co/metrics/accuracy), on a scale between 0.0 and 1.0.
76
+ - `precision`: the average [precision](https://huggingface.co/metrics/precision), on a scale between 0.0 and 1.0.
77
+ - `recall`: the average [recall](https://huggingface.co/metrics/recall), on a scale between 0.0 and 1.0.
78
+ - `f1`: the average [F1 score](https://huggingface.co/metrics/f1), which is the harmonic mean of the precision and recall. It also has a scale of 0.0 to 1.0.
79
+
80
+ Per label type:
81
+ - `precision`: the average [precision](https://huggingface.co/metrics/precision), on a scale between 0.0 and 1.0.
82
+ - `recall`: the average [recall](https://huggingface.co/metrics/recall), on a scale between 0.0 and 1.0.
83
+ - `f1`: the average [F1 score](https://huggingface.co/metrics/f1), on a scale between 0.0 and 1.0.
84
+
85
+ ### Results
86
+
87
+ | Label | Precision | Recall | f1-score | Support |
88
+ | :----------: | :-------: | :----: | :------: | :-----: |
89
+ | 0:arg0:agt | 0.93 | 0.94 | 0.93 | 867 |
90
+ | 0:arg0:cau | 0.76 | 0.67 | 0.71 | 57 |
91
+ | 0:arg0:src | 0.00 | 0.00 | 0.00 | 1 |
92
+ | 0:arg1:ext | 0.00 | 0.00 | 0.00 | 3 |
93
+ | 0:arg1:pat | 0.88 | 0.90 | 0.89 | 536 |
94
+ | 0:arg1:tem | 0.88 | 0.89 | 0.89 | 589 |
95
+ | 0:arg2:atr | 0.85 | 0.90 | 0.87 | 278 |
96
+ | 0:arg2:ben | 0.81 | 0.90 | 0.85 | 78 |
97
+ | 0:arg2:efi | 0.75 | 0.43 | 0.55 | 7 |
98
+ | 0:arg2:exp | 0.60 | 0.50 | 0.55 | 6 |
99
+ | 0:arg2:ext | 0.56 | 0.60 | 0.58 | 15 |
100
+ | 0:arg2:loc | 0.66 | 0.40 | 0.50 | 57 |
101
+ | 0:arg3:ben | 0.50 | 0.20 | 0.29 | 5 |
102
+ | 0:arg3:ein | 0.33 | 1.00 | 0.50 | 1 |
103
+ | 0:arg3:fin | 0.67 | 1.00 | 0.80 | 2 |
104
+ | 0:arg3:ori | 0.50 | 0.50 | 0.50 | 10 |
105
+ | 0:arg4:des | 0.52 | 0.88 | 0.65 | 16 |
106
+ | 0:arg4:efi | 0.50 | 0.40 | 0.44 | 5 |
107
+ | 0:argM:adv | 0.65 | 0.59 | 0.62 | 268 |
108
+ | 0:argM:atr | 0.58 | 0.46 | 0.51 | 24 |
109
+ | 0:argM:cau | 0.70 | 0.63 | 0.67 | 41 |
110
+ | 0:argM:ext | 0.00 | 0.00 | 0.00 | 5 |
111
+ | 0:argM:fin | 0.80 | 0.80 | 0.80 | 46 |
112
+ | 0:argM:loc | 0.71 | 0.83 | 0.77 | 186 |
113
+ | 0:argM:mnr | 0.72 | 0.55 | 0.62 | 66 |
114
+ | 0:argM:tmp | 0.87 | 0.87 | 0.87 | 411 |
115
+ | 0:root | 0.99 | 0.99 | 0.99 | 1662 |
116
+ | 1:arg0:agt | 0.93 | 0.91 | 0.92 | 564 |
117
+ | 1:arg0:cau | 0.73 | 0.80 | 0.76 | 44 |
118
+ | 1:arg1:ext | 0.00 | 0.00 | 0.00 | 2 |
119
+ | 1:arg1:pat | 0.88 | 0.90 | 0.89 | 482 |
120
+ | 1:arg1:tem | 0.90 | 0.90 | 0.90 | 390 |
121
+ | 1:arg2:atr | 0.86 | 0.90 | 0.88 | 197 |
122
+ | 1:arg2:ben | 0.80 | 0.86 | 0.83 | 66 |
123
+ | 1:arg2:efi | 0.60 | 0.50 | 0.55 | 6 |
124
+ | 1:arg2:ext | 0.57 | 0.57 | 0.57 | 7 |
125
+ | 1:arg2:ins | 0.00 | 0.00 | 0.00 | 1 |
126
+ | 1:arg2:loc | 0.67 | 0.64 | 0.65 | 44 |
127
+ | 1:arg3:ben | 0.00 | 0.00 | 0.00 | 2 |
128
+ | 1:arg3:ein | 0.00 | 0.00 | 0.00 | 3 |
129
+ | 1:arg3:fin | 1.00 | 1.00 | 1.00 | 2 |
130
+ | 1:arg3:ori | 0.14 | 0.50 | 0.22 | 2 |
131
+ | 1:arg4:des | 0.50 | 0.90 | 0.64 | 10 |
132
+ | 1:arg4:efi | 1.00 | 0.50 | 0.67 | 2 |
133
+ | 1:argM:adv | 0.59 | 0.61 | 0.60 | 220 |
134
+ | 1:argM:atr | 0.63 | 0.63 | 0.63 | 19 |
135
+ | 1:argM:cau | 0.78 | 0.60 | 0.68 | 35 |
136
+ | 1:argM:ext | 0.00 | 0.00 | 0.00 | 7 |
137
+ | 1:argM:fin | 0.55 | 0.63 | 0.59 | 38 |
138
+ | 1:argM:loc | 0.74 | 0.79 | 0.76 | 156 |
139
+ | 1:argM:mnr | 0.60 | 0.27 | 0.37 | 44 |
140
+ | 1:argM:tmp | 0.81 | 0.82 | 0.82 | 247 |
141
+ | 1:root | 0.96 | 0.96 | 0.96 | 1323 |
142
+ | 2:arg0:agt | 0.88 | 0.89 | 0.88 | 336 |
143
+ | 2:arg0:cau | 0.76 | 0.80 | 0.78 | 35 |
144
+ | 2:arg0:exp | 0.00 | 0.00 | 0.00 | 1 |
145
+ | 2:arg0:src | 0.00 | 0.00 | 0.00 | 1 |
146
+ | 2:arg1:pat | 0.86 | 0.86 | 0.86 | 333 |
147
+ | 2:arg1:tem | 0.86 | 0.85 | 0.86 | 291 |
148
+ | 2:arg2:atr | 0.87 | 0.88 | 0.87 | 124 |
149
+ | 2:arg2:ben | 0.66 | 0.86 | 0.75 | 43 |
150
+ | 2:arg2:efi | 0.86 | 0.67 | 0.75 | 9 |
151
+ | 2:arg2:ext | 0.60 | 0.60 | 0.60 | 5 |
152
+ | 2:arg2:ins | 0.00 | 0.00 | 0.00 | 1 |
153
+ | 2:arg2:loc | 0.47 | 0.52 | 0.49 | 27 |
154
+ | 2:arg3:ben | 1.00 | 0.25 | 0.40 | 4 |
155
+ | 2:arg3:ein | 0.00 | 0.00 | 0.00 | 1 |
156
+ | 2:arg3:ori | 0.38 | 1.00 | 0.55 | 3 |
157
+ | 2:arg4:des | 0.56 | 0.88 | 0.68 | 16 |
158
+ | 2:arg4:efi | 0.00 | 0.00 | 0.00 | 6 |
159
+ | 2:argM:adv | 0.60 | 0.54 | 0.57 | 176 |
160
+ | 2:argM:atr | 0.56 | 0.33 | 0.42 | 15 |
161
+ | 2:argM:cau | 0.53 | 0.53 | 0.53 | 17 |
162
+ | 2:argM:ext | 0.00 | 0.00 | 0.00 | 4 |
163
+ | 2:argM:fin | 0.71 | 0.69 | 0.70 | 36 |
164
+ | 2:argM:ins | 0.00 | 0.00 | 0.00 | 1 |
165
+ | 2:argM:loc | 0.69 | 0.78 | 0.73 | 117 |
166
+ | 2:argM:mnr | 0.45 | 0.26 | 0.33 | 35 |
167
+ | 2:argM:tmp | 0.74 | 0.79 | 0.77 | 161 |
168
+ | 2:root | 0.93 | 0.94 | 0.94 | 913 |
169
+ | 3:arg0:agt | 0.85 | 0.89 | 0.87 | 227 |
170
+ | 3:arg0:cau | 0.69 | 0.64 | 0.67 | 14 |
171
+ | 3:arg1:pat | 0.84 | 0.90 | 0.87 | 199 |
172
+ | 3:arg1:tem | 0.82 | 0.79 | 0.81 | 160 |
173
+ | 3:arg2:atr | 0.80 | 0.81 | 0.81 | 79 |
174
+ | 3:arg2:ben | 0.81 | 0.93 | 0.86 | 27 |
175
+ | 3:arg2:efi | 0.00 | 0.00 | 0.00 | 1 |
176
+ | 3:arg2:ext | 0.00 | 0.00 | 0.00 | 3 |
177
+ | 3:arg2:loc | 0.53 | 0.43 | 0.47 | 21 |
178
+ | 3:arg3:ben | 0.00 | 0.00 | 0.00 | 3 |
179
+ | 3:arg3:ein | 0.00 | 0.00 | 0.00 | 2 |
180
+ | 3:arg3:ori | 0.25 | 0.33 | 0.29 | 3 |
181
+ | 3:arg4:des | 0.41 | 1.00 | 0.58 | 7 |
182
+ | 3:arg4:efi | 0.00 | 0.00 | 0.00 | 5 |
183
+ | 3:argM:adv | 0.54 | 0.47 | 0.50 | 98 |
184
+ | 3:argM:atr | 0.67 | 0.29 | 0.40 | 7 |
185
+ | 3:argM:cau | 0.50 | 0.46 | 0.48 | 13 |
186
+ | 3:argM:ext | 0.00 | 0.00 | 0.00 | 1 |
187
+ | 3:argM:fin | 0.60 | 0.40 | 0.48 | 15 |
188
+ | 3:argM:loc | 0.74 | 0.67 | 0.70 | 69 |
189
+ | 3:argM:mnr | 0.23 | 0.27 | 0.25 | 11 |
190
+ | 3:argM:tmp | 0.85 | 0.79 | 0.82 | 92 |
191
+ | 3:root | 0.92 | 0.93 | 0.93 | 569 |
192
+ | 4:arg0:agt | 0.88 | 0.86 | 0.87 | 119 |
193
+ | 4:arg0:cau | 1.00 | 0.67 | 0.80 | 6 |
194
+ | 4:arg1:pat | 0.77 | 0.78 | 0.78 | 87 |
195
+ | 4:arg1:tem | 0.85 | 0.75 | 0.80 | 109 |
196
+ | 4:arg2:atr | 0.74 | 0.70 | 0.72 | 53 |
197
+ | 4:arg2:ben | 0.64 | 0.82 | 0.72 | 11 |
198
+ | 4:arg2:ext | 0.00 | 0.00 | 0.00 | 1 |
199
+ | 4:arg2:loc | 1.00 | 0.64 | 0.78 | 11 |
200
+ | 4:arg3:ein | 0.00 | 0.00 | 0.00 | 1 |
201
+ | 4:arg3:ori | 0.00 | 0.00 | 0.00 | 1 |
202
+ | 4:arg4:des | 0.67 | 0.60 | 0.63 | 10 |
203
+ | 4:arg4:efi | 0.00 | 0.00 | 0.00 | 1 |
204
+ | 4:argM:adv | 0.48 | 0.50 | 0.49 | 50 |
205
+ | 4:argM:atr | 0.00 | 0.00 | 0.00 | 4 |
206
+ | 4:argM:cau | 0.00 | 0.00 | 0.00 | 3 |
207
+ | 4:argM:ext | 0.00 | 0.00 | 0.00 | 1 |
208
+ | 4:argM:fin | 0.67 | 0.73 | 0.70 | 11 |
209
+ | 4:argM:loc | 0.60 | 0.75 | 0.67 | 24 |
210
+ | 4:argM:mnr | 0.50 | 0.19 | 0.27 | 16 |
211
+ | 4:argM:tmp | 0.86 | 0.69 | 0.77 | 52 |
212
+ | 4:root | 0.90 | 0.87 | 0.88 | 322 |
213
+ | 5:arg0:agt | 0.77 | 0.69 | 0.73 | 72 |
214
+ | 5:arg0:cau | 1.00 | 0.20 | 0.33 | 5 |
215
+ | 5:arg1:pat | 0.65 | 0.69 | 0.67 | 71 |
216
+ | 5:arg1:tem | 0.66 | 0.51 | 0.58 | 41 |
217
+ | 5:arg2:atr | 0.39 | 0.57 | 0.46 | 21 |
218
+ | 5:arg2:ben | 0.45 | 0.83 | 0.59 | 6 |
219
+ | 5:arg2:efi | 0.00 | 0.00 | 0.00 | 1 |
220
+ | 5:arg2:ext | 0.00 | 0.00 | 0.00 | 1 |
221
+ | 5:arg2:loc | 0.00 | 0.00 | 0.00 | 1 |
222
+ | 5:arg3:ein | 0.00 | 0.00 | 0.00 | 1 |
223
+ | 5:arg4:des | 0.00 | 0.00 | 0.00 | 1 |
224
+ | 5:arg4:efi | 0.00 | 0.00 | 0.00 | 1 |
225
+ | 5:argM:adv | 0.41 | 0.35 | 0.38 | 26 |
226
+ | 5:argM:cau | 0.00 | 0.00 | 0.00 | 3 |
227
+ | 5:argM:fin | 0.33 | 0.60 | 0.43 | 5 |
228
+ | 5:argM:loc | 0.58 | 0.52 | 0.55 | 21 |
229
+ | 5:argM:mnr | 0.00 | 0.00 | 0.00 | 7 |
230
+ | 5:argM:tmp | 0.65 | 0.80 | 0.72 | 30 |
231
+ | 5:root | 0.77 | 0.66 | 0.71 | 173 |
232
+ | 6:arg0:agt | 0.56 | 0.65 | 0.60 | 34 |
233
+ | 6:arg0:cau | 0.00 | 0.00 | 0.00 | 1 |
234
+ | 6:arg1:loc | 0.00 | 0.00 | 0.00 | 1 |
235
+ | 6:arg1:pat | 0.45 | 0.79 | 0.57 | 28 |
236
+ | 6:arg1:tem | 0.27 | 0.25 | 0.26 | 16 |
237
+ | 6:arg2:atr | 0.46 | 0.46 | 0.46 | 13 |
238
+ | 6:arg2:ben | 0.33 | 0.60 | 0.43 | 5 |
239
+ | 6:arg2:loc | 0.00 | 0.00 | 0.00 | 1 |
240
+ | 6:arg3:ben | 0.00 | 0.00 | 0.00 | 1 |
241
+ | 6:argM:adv | 0.27 | 0.70 | 0.39 | 10 |
242
+ | 6:argM:atr | 0.00 | 0.00 | 0.00 | 2 |
243
+ | 6:argM:cau | 0.00 | 0.00 | 0.00 | 1 |
244
+ | 6:argM:fin | 0.00 | 0.00 | 0.00 | 2 |
245
+ | 6:argM:loc | 0.25 | 0.57 | 0.35 | 7 |
246
+ | 6:argM:mnr | 0.00 | 0.00 | 0.00 | 5 |
247
+ | 6:argM:tmp | 0.46 | 0.86 | 0.60 | 7 |
248
+ | 6:root | 0.46 | 0.55 | 0.50 | 82 |
249
+ | 7:arg0:agt | 0.33 | 0.88 | 0.48 | 17 |
250
+ | 7:arg1:pat | 0.41 | 0.71 | 0.52 | 17 |
251
+ | 7:arg1:tem | 0.50 | 0.80 | 0.62 | 15 |
252
+ | 7:arg2:atr | 0.50 | 0.60 | 0.55 | 15 |
253
+ | 7:arg2:ben | 0.00 | 0.00 | 0.00 | 7 |
254
+ | 7:arg2:loc | 0.00 | 0.00 | 0.00 | 1 |
255
+ | 7:arg3:ori | 0.00 | 0.00 | 0.00 | 1 |
256
+ | 7:arg4:des | 1.00 | 1.00 | 1.00 | 1 |
257
+ | 7:argM:adv | 0.17 | 0.40 | 0.24 | 5 |
258
+ | 7:argM:atr | 0.00 | 0.00 | 0.00 | 1 |
259
+ | 7:argM:fin | 0.00 | 0.00 | 0.00 | 1 |
260
+ | 7:argM:loc | 0.00 | 0.00 | 0.00 | 3 |
261
+ | 7:argM:tmp | 0.33 | 0.33 | 0.33 | 6 |
262
+ | 7:root | 0.43 | 0.78 | 0.55 | 45 |
263
+ | 8:arg0:agt | 0.00 | 0.00 | 0.00 | 8 |
264
+ | 8:arg0:cau | 0.00 | 0.00 | 0.00 | 1 |
265
+ | 8:arg1:pat | 0.00 | 0.00 | 0.00 | 4 |
266
+ | 8:arg1:tem | 0.24 | 0.44 | 0.31 | 9 |
267
+ | 8:arg2:atr | 0.10 | 0.25 | 0.14 | 4 |
268
+ | 8:arg2:ben | 0.00 | 0.00 | 0.00 | 0 |
269
+ | 8:arg2:ext | 0.00 | 0.00 | 0.00 | 1 |
270
+ | 8:arg2:loc | 0.00 | 0.00 | 0.00 | 2 |
271
+ | 8:arg3:ori | 0.00 | 0.00 | 0.00 | 1 |
272
+ | 8:argM:adv | 0.13 | 0.25 | 0.17 | 8 |
273
+ | 8:argM:ext | 0.00 | 0.00 | 0.00 | 1 |
274
+ | 8:argM:fin | 0.00 | 0.00 | 0.00 | 1 |
275
+ | 8:argM:loc | 0.00 | 0.00 | 0.00 | 4 |
276
+ | 8:argM:mnr | 0.00 | 0.00 | 0.00 | 1 |
277
+ | 8:argM:tmp | 0.00 | 0.00 | 0.00 | 1 |
278
+ | 8:root | 0.38 | 0.72 | 0.50 | 25 |
279
+ | 9:arg0:agt | 0.00 | 0.00 | 0.00 | 6 |
280
+ | 9:arg0:cau | 0.00 | 0.00 | 0.00 | 1 |
281
+ | 9:arg1:pat | 0.00 | 0.00 | 0.00 | 4 |
282
+ | 9:arg1:tem | 0.00 | 0.00 | 0.00 | 5 |
283
+ | 9:arg2:atr | 0.00 | 0.00 | 0.00 | 3 |
284
+ | 9:arg2:ben | 0.00 | 0.00 | 0.00 | 1 |
285
+ | 9:argM:adv | 0.00 | 0.00 | 0.00 | 6 |
286
+ | 9:argM:cau | 0.00 | 0.00 | 0.00 | 1 |
287
+ | 9:argM:fin | 0.00 | 0.00 | 0.00 | 2 |
288
+ | 9:argM:loc | 0.00 | 0.00 | 0.00 | 2 |
289
+ | 9:argM:tmp | 0.00 | 0.00 | 0.00 | 1 |
290
+ | 9:root | 0.09 | 0.18 | 0.12 | 17 |
291
+ | 10:arg0:agt | 0.00 | 0.00 | 0.00 | 3 |
292
+ | 10:arg1:pat | 0.00 | 0.00 | 0.00 | 5 |
293
+ | 10:arg1:tem | 0.00 | 0.00 | 0.00 | 3 |
294
+ | 10:arg2:atr | 0.00 | 0.00 | 0.00 | 1 |
295
+ | 10:arg2:ben | 0.00 | 0.00 | 0.00 | 2 |
296
+ | 10:argM:adv | 0.00 | 0.00 | 0.00 | 3 |
297
+ | 10:argM:fin | 0.00 | 0.00 | 0.00 | 1 |
298
+ | 10:argM:tmp | 0.00 | 0.00 | 0.00 | 1 |
299
+ | 10:root | 0.00 | 0.00 | 0.00 | 12 |
300
+ | 11:arg0:agt | 0.00 | 0.00 | 0.00 | 1 |
301
+ | 11:arg0:cau | 0.00 | 0.00 | 0.00 | 1 |
302
+ | 11:arg1:pat | 0.00 | 0.00 | 0.00 | 2 |
303
+ | 11:arg1:tem | 0.00 | 0.00 | 0.00 | 4 |
304
+ | 11:arg2:atr | 0.00 | 0.00 | 0.00 | 3 |
305
+ | 11:arg2:ben | 0.00 | 0.00 | 0.00 | 1 |
306
+ | 11:argM:adv | 0.00 | 0.00 | 0.00 | 4 |
307
+ | 11:argM:loc | 0.00 | 0.00 | 0.00 | 1 |
308
+ | 11:argM:tmp | 0.00 | 0.00 | 0.00 | 1 |
309
+ | 11:root | 0.00 | 0.00 | 0.00 | 9 |
310
+ | 12:arg0:agt | 0.00 | 0.00 | 0.00 | 3 |
311
+ | 12:arg1:pat | 0.00 | 0.00 | 0.00 | 1 |
312
+ | 12:arg1:tem | 0.00 | 0.00 | 0.00 | 2 |
313
+ | 12:arg2:atr | 0.00 | 0.00 | 0.00 | 2 |
314
+ | 12:argM:adv | 0.00 | 0.00 | 0.00 | 1 |
315
+ | 12:argM:cau | 0.00 | 0.00 | 0.00 | 1 |
316
+ | 12:argM:tmp | 0.00 | 0.00 | 0.00 | 3 |
317
+ | 12:root | 0.00 | 0.00 | 0.00 | 7 |
318
+ | 13:arg0:cau | 0.00 | 0.00 | 0.00 | 1 |
319
+ | 13:arg1:tem | 0.00 | 0.00 | 0.00 | 1 |
320
+ | 13:arg2:atr | 0.00 | 0.00 | 0.00 | 1 |
321
+ | 13:argM:adv | 0.00 | 0.00 | 0.00 | 1 |
322
+ | 13:argM:atr | 0.00 | 0.00 | 0.00 | 1 |
323
+ | 13:argM:loc | 0.00 | 0.00 | 0.00 | 1 |
324
+ | 13:root | 0.00 | 0.00 | 0.00 | 4 |
325
+ | 14:arg1:pat | 0.00 | 0.00 | 0.00 | 1 |
326
+ | 14:arg2:ben | 0.00 | 0.00 | 0.00 | 1 |
327
+ | 14:argM:mnr | 0.00 | 0.00 | 0.00 | 1 |
328
+ | 14:root | 0.00 | 0.00 | 0.00 | 2 |
329
+ | micro avg | 0.84 | 0.84 | 0.84 | 15436 |
330
+ | macro avg | 0.34 | 0.36 | 0.34 | 15436 |
331
+ | weighted avg | 0.83 | 0.84 | 0.83 | 15436 |
332
+ | tot root avg | 0.46 | 0.51 | 0.47 | 5165 |
333
+ | tot arg0:agt avg | 0.47 | 0.52 | 0.48 | 2257 |
334
+ | tot arg0:cau avg | 0.45 | 0.34 | 0.37 | 166 |
335
+ | tot arg0:exp avg | 0.00 | 0.00 | 0.00 | 1 |
336
+ | tot arg0:src avg | 0.00 | 0.00 | 0.00 | 2 |
337
+ | tot arg0 | 0.41 | 0.39 | 0.38 | 2426 |
338
+ | tot arg1:ext avg | 0.00 | 0.00 | 0.00 | 5 |
339
+ | tot arg1:loc avg | 0.00 | 0.00 | 0.00 | 1 |
340
+ | tot arg1:pat avg | 0.41 | 0.47 | 0.43 | 1770 |
341
+ | tot arg1:tem avg | 0.43 | 0.44 | 0.43 | 1635 |
342
+ | tot arg1 | 0.38 | 0.41 | 0.39 | 3411 |
343
+ | tot arg2:atr avg | 0.40 | 0.43 | 0.41 | 794 |
344
+ | tot arg2:ben avg | 0.35 | 0.45 | 0.39 | 248 |
345
+ | tot arg2:efi avg | 0.44 | 0.32 | 0.37 | 24 |
346
+ | tot arg2:exp avg | 0.60 | 0.50 | 0.55 | 6 |
347
+ | tot arg2:ext avg | 0.25 | 0.25 | 0.25 | 33 |
348
+ | tot arg2:ins avg | 0.00 | 0.00 | 0.00 | 2 |
349
+ | tot arg2:loc avg | 0.37 | 0.29 | 0.32 | 165 |
350
+ | tot arg2 | 0.35 | 0.36 | 0.35 | 1272 |
351
+ | tot arg3:ben avg | 0.30 | 0.09 | 0.14 | 15 |
352
+ | tot arg3:ein avg | 0.06 | 0.17 | 0.08 | 9 |
353
+ | tot arg3:fin avg | 0.84 | 1.00 | 0.90 | 4 |
354
+ | tot arg3:ori avg | 0.18 | 0.33 | 0.22 | 21 |
355
+ | tot arg3 | 0.24 | 0.29 | 0.23 | 49 |
356
+ | tot arg4:des avg | 0.52 | 0.75 | 0.60 | 61 |
357
+ | tot arg4:efi avg | 0.25 | 0.15 | 0.19 | 20 |
358
+ | tot arg4 | 0.40 | 0.47 | 0.41 | 81 |
359
+ | tot argM:adv avg | 0.27 | 0.32 | 0.28 | 876 |
360
+ | tot argM:atr avg | 0.31 | 0.21 | 0.25 | 73 |
361
+ | tot argM:cau avg | 0.28 | 0.25 | 0.26 | 115 |
362
+ | tot argM:ext avg | 0.00 | 0.00 | 0.00 | 19 |
363
+ | tot argM:fin avg | 0.33 | 0.35 | 0.34 | 158 |
364
+ | tot argM:ins avg | 0.00 | 0.00 | 0.00 | 1 |
365
+ | tot argM:loc avg | 0.36 | 0.41 | 0.38 | 591 |
366
+ | tot argM:mnr avg | 0.28 | 0.17 | 0.20 | 186 |
367
+ | tot argM:tmp avg | 0.43 | 0.46 | 0.44 | 1013 |
368
+ | tot argM | 0.30 | 0.30 | 0.29 | 3032 |
369
+ | tot r0 avg | 0.62 | 0.62 | 0.61 | 5242 |
370
+ | tot r1 avg | 0.59 | 0.58 | 0.57 | 3913 |
371
+ | tot r2 avg | 0.52 | 0.52 | 0.50 | 2711 |
372
+ | tot r3 avg | 0.48 | 0.48 | 0.47 | 1626 |
373
+ | tot r4 avg | 0.48 | 0.43 | 0.45 | 843 |
374
+ | tot r5 avg | 0.35 | 0.34 | 0.32 | 487 |
375
+ | tot r6 avg | 0.21 | 0.32 | 0.24 | 216 |
376
+ | tot r7 avg | 0.26 | 0.39 | 0.31 | 135 |
377
+ | tot r8 avg | 0.05 | 0.10 | 0.07 | 71 |
378
+ | tot r9 avg | 0.01 | 0.02 | 0.01 | 49 |
379
+ | tot r10 avg | 0.00 | 0.00 | 0.00 | 31 |
380
+ | tot r11 avg | 0.00 | 0.00 | 0.00 | 27 |
381
+ | tot r12 avg | 0.00 | 0.00 | 0.00 | 20 |
382
+ | tot r13 avg | 0.00 | 0.00 | 0.00 | 10 |
383
+ | tot r14 avg | 0.00 | 0.00 | 0.00 | 5 |
384
+
385
+ ## Citation
386
+
387
+ **BibTeX:**
388
+
389
+ ```
390
+ @mastersthesis{bruton-galician-srl-23,
391
+ author = {Bruton, Micaella},
392
+ title = {BERTie Bott's Every Flavor Labels: A Tasty Guide to Developing a Semantic Role Labeling Model for Galician},
393
+ school = {Uppsala University},
394
+ year = {2023},
395
+ type = {Master's thesis},
396
+ }
397
+ ```