Updated with performance metrics
Browse files
README.md
CHANGED
|
@@ -66,4 +66,42 @@ DaCy also contains guides on usage of the package as well as behavioural test fo
|
|
| 66 |
| `ENTS_P` | 77.18 |
|
| 67 |
| `ENTS_R` | 77.29 |
|
| 68 |
| `TRANSFORMER_LOSS` | 80975.57 |
|
| 69 |
-
| `NER_LOSS` | 90852.49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 66 |
| `ENTS_P` | 77.18 |
|
| 67 |
| `ENTS_R` | 77.29 |
|
| 68 |
| `TRANSFORMER_LOSS` | 80975.57 |
|
| 69 |
+
| `NER_LOSS` | 90852.49 |
|
| 70 |
+
|
| 71 |
+
### Performance tables
|
| 72 |
+
|
| 73 |
+
The three tables below show the F1-scores for the three DaCy fine-grained models.
|
| 74 |
+
|
| 75 |
+
| Domain | DaCy large | DaCy medium | DaCy small |
|
| 76 |
+
|:--------------------: |:----------: |:-----------: |:----------: |
|
| 77 |
+
| All domains combined | 0.823 | 0.806 | 0.776 |
|
| 78 |
+
| Conversation | 0.796 | 0.718 | 0.82 |
|
| 79 |
+
| Dannet | 0.75 | 0.667 | 1 |
|
| 80 |
+
| Legal | 0.852 | 0.854 | 0.866 |
|
| 81 |
+
| News | 0.841 | 0.759 | 0.86 |
|
| 82 |
+
| Social Media | 0.793 | 0.847 | 0.8 |
|
| 83 |
+
| Web | 0.826 | 0.802 | 0.756 |
|
| 84 |
+
| Wiki and Books | 0.778 | 0.838 | 0.709 |
|
| 85 |
+
|
| 86 |
+
| Domain | DaCy large | DaCy medium | DaCy small |
|
| 87 |
+
|:--------------------: |:----------: |:-----------: |:----------: |
|
| 88 |
+
| All domains combined | 0.823 | 0.806 | 0.776 |
|
| 89 |
+
| Conversation | 0.796 | 0.718 | 0.82 |
|
| 90 |
+
| Dannet | 0.75 | 0.667 | 1 |
|
| 91 |
+
| Legal | 0.852 | 0.854 | 0.866 |
|
| 92 |
+
| News | 0.841 | 0.759 | 0.86 |
|
| 93 |
+
| Social Media | 0.793 | 0.847 | 0.8 |
|
| 94 |
+
| Web | 0.826 | 0.802 | 0.756 |
|
| 95 |
+
| Wiki and Books | 0.778 | 0.838 | 0.709 |
|
| 96 |
+
|
| 97 |
+
| Domain | DaCy large | DaCy medium | DaCy small |
|
| 98 |
+
|:--------------------: |:----------: |:-----------: |:----------: |
|
| 99 |
+
| All domains combined | 0.823 | 0.806 | 0.776 |
|
| 100 |
+
| Conversation | 0.796 | 0.718 | 0.82 |
|
| 101 |
+
| Dannet | 0.75 | 0.667 | 1 |
|
| 102 |
+
| Legal | 0.852 | 0.854 | 0.866 |
|
| 103 |
+
| News | 0.841 | 0.759 | 0.86 |
|
| 104 |
+
| Social Media | 0.793 | 0.847 | 0.8 |
|
| 105 |
+
| Web | 0.826 | 0.802 | 0.756 |
|
| 106 |
+
| Wiki and Books | 0.778 | 0.838 | 0.709 |
|
| 107 |
+
|