emiltj commited on
Commit
1ba5c03
1 Parent(s): f24ea3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -1
README.md CHANGED
@@ -66,4 +66,48 @@ DaCy also contains guides on usage of the package as well as behavioural test fo
66
  | `ENTS_P` | 81.00 |
67
  | `ENTS_R` | 82.03 |
68
  | `TRANSFORMER_LOSS` | 63375.61 |
69
- | `NER_LOSS` | 158164.20 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
66
  | `ENTS_P` | 81.00 |
67
  | `ENTS_R` | 82.03 |
68
  | `TRANSFORMER_LOSS` | 63375.61 |
69
+ | `NER_LOSS` | 158164.20 |
70
+
71
+
72
+ ### Performance tables
73
+
74
+ The table below shows the F1, recall and precision of the three DaCy fine-grained models.
75
+ | Score | DaCy large | DaCy medium | DaCy small |
76
+ |:---:|:---:|:---:|:---:|
77
+ | F1 | 0.823 | 0.806 | 0.776 |
78
+ | Recall | 0.834 | 0.818 | 0.77 |
79
+ | Precision | 0.813 | 0.794 | 0.781 |
80
+
81
+ The table below shows the F1 of the three DaCy fine-grained models within each named entity type.
82
+ | Named-entity type | DaCy large | DaCy medium | DaCy small |
83
+ |:---:|:---:|:---:|:---:|
84
+ | CARDINAL | 0.874 | 0.781 | 0.887 |
85
+ | DATE | 0.846 | 0.859 | 0.867 |
86
+ | EVENT | 0.611 | 0.571 | 0.4 |
87
+ | FACILITY | 0.545 | 0.533 | 0.468 |
88
+ | GPE | 0.893 | 0.838 | 0.794 |
89
+ | LANGUAGE | 0.902 | 0.486 | 0.194 |
90
+ | LAW | 0.686 | 0.625 | 0.606 |
91
+ | LOCATION | 0.633 | 0.737 | 0.581 |
92
+ | MONEY | 0.993 | 1 | 0.947 |
93
+ | NORP | 0.78 | 0.887 | 0.785 |
94
+ | ORDINAL | 0.696 | 0.7 | 0.727 |
95
+ | ORGANIZATION | 0.863 | 0.851 | 0.781 |
96
+ | PERCENT | 0.923 | 0.96 | 0.96 |
97
+ | PERSON | 0.871 | 0.872 | 0.833 |
98
+ | PRODUCT | 0.671 | 0.635 | 0.526 |
99
+ | QUANTITY | 0.386 | 0.654 | 0.708 |
100
+ | TIME | 0.643 | 0.571 | 0.71 |
101
+ | WORK OF ART | 0.494 | 0.639 | 0.488 |
102
+
103
+ The table below shows the F1 of the three DaCy fine-grained models within each domain of texts in DANSK.
104
+ | Domain | DaCy large | DaCy medium | DaCy small |
105
+ |:---:|:---:|:---:|:---:|
106
+ | All domains combined | 0.823 | 0.806 | 0.776 |
107
+ | Conversation | 0.796 | 0.718 | 0.82 |
108
+ | Dannet | 0.75 | 0.667 | 1 |
109
+ | Legal | 0.852 | 0.854 | 0.866 |
110
+ | News | 0.841 | 0.759 | 0.86 |
111
+ | Social Media | 0.793 | 0.847 | 0.8 |
112
+ | Web | 0.826 | 0.802 | 0.756 |
113
+ | Wiki and Books | 0.778 | 0.838 | 0.709 |