|
--- |
|
license: |
|
- mit |
|
datasets: |
|
- xtreme |
|
language: |
|
- it |
|
- en |
|
- de |
|
- fr |
|
- es |
|
metrics: |
|
- precision: 0.874 |
|
- recall: 0.880 |
|
- f1: 0.877 |
|
- accuracy: 0.943 |
|
--- |
|
|
|
# gunghio/xlm-roberta-base-finetuned-panx-ner |
|
|
|
This model was trained starting from xlm-roberta-base on a subset of xtreme dataset. |
|
|
|
`xtreme` datasets subsets used are: PAN-X.{lang}. |
|
|
|
Only 75% of the whole dataset was used. |
|
|
|
## Intended uses & limitations |
|
|
|
Fine-tuned model can be used for Named Entity Recognition in it, en, de, fr, and es. |
|
|
|
## Training and evaluation data |
|
|
|
Training dataset: [conll2003](https://huggingface.co/datasets/xtreme) |
|
|
|
### Training results |
|
|
|
It achieves the following results on the evaluation set: |
|
|
|
- Precision: 0.8744154472771157 |
|
- Recall: 0.8791424269015351 |
|
- F1: 0.8767725659462058 |
|
- Accuracy: 0.9432040948504613 |
|
|
|
Details: |
|
|
|
| Label | Precision | Recall | F1-Score | Support | |
|
|---------|-----------|--------|----------|---------| |
|
| PER | 0.922 | 0.908 | 0.915 | 26639 | |
|
| LOC | 0.880 | 0.906 | 0.892 | 37623 | |
|
| ORG | 0.821 | 0.816 | 0.818 | 28045 | |
|
| Overall | 0.922 | 0.908 | .915 | 26639 | |
|
|
|
|
