yeshpanovrustem commited on
Commit
cfe11f6
1 Parent(s): 05f13d5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -1
README.md CHANGED
@@ -24,14 +24,17 @@ widget:
24
  datasets:
25
  - yeshpanovrustem/kaznerd_cleaned
26
  ---
 
27
  # A Named Entity Recognition Model for Kazakh
28
  - The model was inspired by the [LREC 2022](https://lrec2022.lrec-conf.org/en/) paper [*KazNERD: Kazakh Named Entity Recognition Dataset*](https://aclanthology.org/2022.lrec-1.44).
29
  - The original repository for the paper can be found at *https://github.com/IS2AI/KazNERD*.
 
30
  ## Evaluation results on the validation and test sets
31
  | | Validation set | | | Test set| |
32
  |:---:| :---: | :---: | :---: | :---: | :---: |
33
  | **Precision** | **Recall** | **F<sub>1</sub>-score** | **Precision** | **Recall** | **F<sub>1</sub>-score** |
34
  | 96.58% | 96.66% | 96.62% | 96.49% | 96.86% | 96.67% |
 
35
  ## Model performance for the NE classes of the validation set
36
  | NE Class | Precision | Recall | F<sub>1</sub>-score | Support |
37
  | :---: | :---: | :---: | :---: | :---: |
@@ -62,4 +65,36 @@ datasets:
62
  | **TIME** | 94.81% | 96.63% | 95.71% | 208 |
63
  | **micro avg** | **96.58%** | **96.66%** | **96.62%** | **13,189** |
64
  | **macro avg** | **90.12%** | **87.51%** | **88.39%** | **13,189** |
65
- | **weighted avg** | **96.67%** | **96.66%** | **96.63%** | **13,189** |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
  datasets:
25
  - yeshpanovrustem/kaznerd_cleaned
26
  ---
27
+
28
  # A Named Entity Recognition Model for Kazakh
29
  - The model was inspired by the [LREC 2022](https://lrec2022.lrec-conf.org/en/) paper [*KazNERD: Kazakh Named Entity Recognition Dataset*](https://aclanthology.org/2022.lrec-1.44).
30
  - The original repository for the paper can be found at *https://github.com/IS2AI/KazNERD*.
31
+ -
32
  ## Evaluation results on the validation and test sets
33
  | | Validation set | | | Test set| |
34
  |:---:| :---: | :---: | :---: | :---: | :---: |
35
  | **Precision** | **Recall** | **F<sub>1</sub>-score** | **Precision** | **Recall** | **F<sub>1</sub>-score** |
36
  | 96.58% | 96.66% | 96.62% | 96.49% | 96.86% | 96.67% |
37
+
38
  ## Model performance for the NE classes of the validation set
39
  | NE Class | Precision | Recall | F<sub>1</sub>-score | Support |
40
  | :---: | :---: | :---: | :---: | :---: |
 
65
  | **TIME** | 94.81% | 96.63% | 95.71% | 208 |
66
  | **micro avg** | **96.58%** | **96.66%** | **96.62%** | **13,189** |
67
  | **macro avg** | **90.12%** | **87.51%** | **88.39%** | **13,189** |
68
+ | **weighted avg** | **96.67%** | **96.66%** | **96.63%** | **13,189** |
69
+
70
+ ## Model performance for the NE classes of the test set
71
+ | NE Class | Precision | Recall | F<sub>1</sub>-score | Support |
72
+ | :---: | :---: | :---: | :---: | :---: |
73
+ | **ADAGE** | 71.43% | 29.41% | 41.67% | 17 |
74
+ | **ART** | 95.71% | 96.89% | 96.30% | 161 |
75
+ | **CARDINAL** | 98.43% | 98.60% | 98.51% | 2,789 |
76
+ | **CONTACT** | 94.44% | 85.00% | 89.47% | 20 |
77
+ | **DATE** | 96.59% | 97.60% | 97.09% | 2,584 |
78
+ | **DISEASE** | 87.69% | 95.80% | 91.57% | 119 |
79
+ | **EVENT** | 86.67% | 92.86% | 89.66% | 154 |
80
+ | **FACILITY** | 74.88% | 81.73% | 78.16% | 197 |
81
+ | **GPE** | 98.57% | 97.81% | 98.19% | 1,691 |
82
+ | **LANGUAGE** | 90.70% | 95.12% | 92.86% | 41 |
83
+ | **LAW** | 93.33% | 76.36% | 84.00% | 55 |
84
+ | **LOCATION** | 92.08% | 89.42% | 90.73% | 208 |
85
+ | **MISCELLANEOUS** | 86.21% | 96.15% | 90.91% | 26 |
86
+ | **MONEY** | 100.00% | 100.00% | 100.00% | 427 |
87
+ | **NON_HUMAN** | 0.00% | 0.00% | 0.00% | 1 |
88
+ | **NORP** | 99.46% | 99.18% | 99.32% | 368 |
89
+ | **ORDINAL** | 96.63% | 97.64% | 97.14% | 382 |
90
+ | **ORGANISATION** | 90.97% | 91.23% | 91.10% | 718 |
91
+ | **PERCENTAGE** | 98.05% | 98.05% | 98.05% | 462 |
92
+ | **PERSON** | 98.70% | 99.13% | 98.92% | 1,151 |
93
+ | **POSITION** | 96.36% | 97.65% | 97.00% | 597 |
94
+ | **PRODUCT** | 89.23% | 77.33% | 82.86% | 75 |
95
+ | **PROJECT** | 93.69% | 93.69% | 93.69% | 206 |
96
+ | **QUANTITY** | 97.26% | 97.02% | 97.14% | 403 |
97
+ | **TIME** | 94.95% | 94.09% | 94.52% | 220 |
98
+ | **micro avg** | **96.54%** | **96.85%** | **96.69%** | **13,072** |
99
+ | **macro avg** | **88.88%** | **87.11%** | **87.55%** | **13,072** |
100
+ | **weighted avg** | **96.55%** | **96.85%** | **96.67%** | **13,072** |