Gorka Urbizu Garmendia
commited on
Commit
•
1eff28d
1
Parent(s):
be00833
Update README.md
Browse files
README.md
CHANGED
|
@@ -27,11 +27,11 @@ ElhBERTeu was trained following the design decisions for [BERTeus](https://huggi
|
|
| 27 |
|
| 28 |
The model has been evaluated on the recently created BasqueGLUE NLU benchmark:
|
| 29 |
|
| 30 |
-
| Model | AVG
|
| 31 |
-
|
| 32 |
-
| |
|
| 33 |
-
| BERTeus | 73.23
|
| 34 |
-
| ElhBERTeu | 73.71 | 82.30 | 82.24 | 75.64 | 78.05 | 69.89 | 63.81 | 73.84 | 71.71 | 65.93 |
|
| 35 |
|
| 36 |
If you use this model, please cite the following paper:
|
| 37 |
|
|
|
|
| 27 |
|
| 28 |
The model has been evaluated on the recently created BasqueGLUE NLU benchmark:
|
| 29 |
|
| 30 |
+
| Model | AVG | NERC | F_intent | F_slot | BHTC | BEC | Vaxx | QNLI | WiC | coref |
|
| 31 |
+
|-----------|:---------:|:-----:|:---------:|:-------:|:-----:|:-----:|:-----:|:-----:|:-----:|:-----:|
|
| 32 |
+
| | | F1 | F1 | F1 | F1 | F1 | MF1 | acc | acc | acc |
|
| 33 |
+
| BERTeus | 73.23 | 81.92 | 82.52 | 74.34 | 78.26 | 69.43 | 59.30 | 74.26 | 70.71 | 68.31 |
|
| 34 |
+
| ElhBERTeu | **73.71** | 82.30 | 82.24 | 75.64 | 78.05 | 69.89 | 63.81 | 73.84 | 71.71 | 65.93 |
|
| 35 |
|
| 36 |
If you use this model, please cite the following paper:
|
| 37 |
|