adrianeboyd commited on
Commit
1b34cfa
1 Parent(s): 878a400

Update spaCy pipeline

Browse files
.gitattributes CHANGED
@@ -19,3 +19,4 @@
19
  *strings.json filter=lfs diff=lfs merge=lfs -text
20
  vectors filter=lfs diff=lfs merge=lfs -text
21
  model filter=lfs diff=lfs merge=lfs -text
 
 
19
  *strings.json filter=lfs diff=lfs merge=lfs -text
20
  vectors filter=lfs diff=lfs merge=lfs -text
21
  model filter=lfs diff=lfs merge=lfs -text
22
+ vocab/key2row filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -14,13 +14,13 @@ model-index:
14
  metrics:
15
  - name: NER Precision
16
  type: precision
17
- value: 0.7611940299
18
  - name: NER Recall
19
  type: recall
20
- value: 0.7056603774
21
  - name: NER F Score
22
  type: f_score
23
- value: 0.7323759791
24
  - task:
25
  name: TAG
26
  type: token-classification
@@ -34,7 +34,7 @@ model-index:
34
  metrics:
35
  - name: POS (UPOS) Accuracy
36
  type: accuracy
37
- value: 0.9745981102
38
  - task:
39
  name: MORPH
40
  type: token-classification
@@ -48,28 +48,28 @@ model-index:
48
  metrics:
49
  - name: Lemma Accuracy
50
  type: accuracy
51
- value: 0.965013864
52
  - task:
53
  name: UNLABELED_DEPENDENCIES
54
  type: token-classification
55
  metrics:
56
  - name: Unlabeled Attachment Score (UAS)
57
  type: f_score
58
- value: 0.9222457341
59
  - task:
60
  name: LABELED_DEPENDENCIES
61
  type: token-classification
62
  metrics:
63
  - name: Labeled Attachment Score (LAS)
64
  type: f_score
65
- value: 0.9090090901
66
  - task:
67
  name: SENTS
68
  type: token-classification
69
  metrics:
70
  - name: Sentences F-Score
71
  type: f_score
72
- value: 0.9862475442
73
  ---
74
  ### Details: https://spacy.io/models/ja#ja_core_news_lg
75
 
@@ -78,8 +78,8 @@ Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser,
78
  | Feature | Description |
79
  | --- | --- |
80
  | **Name** | `ja_core_news_lg` |
81
- | **Version** | `3.3.0` |
82
- | **spaCy** | `>=3.3.0.dev0,<3.4.0` |
83
  | **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `attribute_ruler`, `ner` |
84
  | **Components** | `tok2vec`, `morphologizer`, `parser`, `senter`, `attribute_ruler`, `ner` |
85
  | **Vectors** | 480443 keys, 480443 unique vectors (300 dimensions) |
@@ -91,11 +91,11 @@ Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser,
91
 
92
  <details>
93
 
94
- <summary>View label scheme (64 labels for 3 components)</summary>
95
 
96
  | Component | Labels |
97
  | --- | --- |
98
- | **`morphologizer`** | `POS=NOUN`, `POS=ADP`, `POS=VERB`, `POS=SCONJ`, `POS=AUX`, `POS=PUNCT`, `POS=PART`, `POS=DET`, `POS=NUM`, `POS=ADV`, `POS=PRON`, `POS=ADJ`, `POS=PROPN`, `POS=CCONJ`, `POS=SYM`, `POS=NOUN\|Polarity=Neg`, `POS=AUX\|Polarity=Neg`, `POS=INTJ`, `POS=SCONJ\|Polarity=Neg` |
99
  | **`parser`** | `ROOT`, `acl`, `advcl`, `advmod`, `amod`, `aux`, `case`, `cc`, `ccomp`, `compound`, `cop`, `csubj`, `dep`, `det`, `dislocated`, `fixed`, `mark`, `nmod`, `nsubj`, `nummod`, `obj`, `obl`, `punct` |
100
  | **`ner`** | `CARDINAL`, `DATE`, `EVENT`, `FAC`, `GPE`, `LANGUAGE`, `LAW`, `LOC`, `MONEY`, `MOVEMENT`, `NORP`, `ORDINAL`, `ORG`, `PERCENT`, `PERSON`, `PET_NAME`, `PHONE`, `PRODUCT`, `QUANTITY`, `TIME`, `TITLE_AFFIX`, `WORK_OF_ART` |
101
 
@@ -109,18 +109,18 @@ Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser,
109
  | `TOKEN_P` | 97.65 |
110
  | `TOKEN_R` | 97.90 |
111
  | `TOKEN_F` | 97.77 |
112
- | `POS_ACC` | 97.46 |
113
  | `MORPH_ACC` | 0.00 |
114
  | `MORPH_MICRO_P` | 34.01 |
115
  | `MORPH_MICRO_R` | 98.04 |
116
  | `MORPH_MICRO_F` | 50.51 |
117
- | `SENTS_P` | 98.24 |
118
- | `SENTS_R` | 99.01 |
119
- | `SENTS_F` | 98.62 |
120
- | `DEP_UAS` | 92.22 |
121
- | `DEP_LAS` | 90.90 |
122
  | `TAG_ACC` | 97.12 |
123
- | `LEMMA_ACC` | 96.50 |
124
- | `ENTS_P` | 76.12 |
125
- | `ENTS_R` | 70.57 |
126
- | `ENTS_F` | 73.24 |
 
14
  metrics:
15
  - name: NER Precision
16
  type: precision
17
+ value: 0.7436241611
18
  - name: NER Recall
19
  type: recall
20
+ value: 0.6968553459
21
  - name: NER F Score
22
  type: f_score
23
+ value: 0.7194805195
24
  - task:
25
  name: TAG
26
  type: token-classification
 
34
  metrics:
35
  - name: POS (UPOS) Accuracy
36
  type: accuracy
37
+ value: 0.9736540664
38
  - task:
39
  name: MORPH
40
  type: token-classification
 
48
  metrics:
49
  - name: Lemma Accuracy
50
  type: accuracy
51
+ value: 0.9670526831
52
  - task:
53
  name: UNLABELED_DEPENDENCIES
54
  type: token-classification
55
  metrics:
56
  - name: Unlabeled Attachment Score (UAS)
57
  type: f_score
58
+ value: 0.9216710183
59
  - task:
60
  name: LABELED_DEPENDENCIES
61
  type: token-classification
62
  metrics:
63
  - name: Labeled Attachment Score (LAS)
64
  type: f_score
65
+ value: 0.909074549
66
  - task:
67
  name: SENTS
68
  type: token-classification
69
  metrics:
70
  - name: Sentences F-Score
71
  type: f_score
72
+ value: 0.9930898322
73
  ---
74
  ### Details: https://spacy.io/models/ja#ja_core_news_lg
75
 
 
78
  | Feature | Description |
79
  | --- | --- |
80
  | **Name** | `ja_core_news_lg` |
81
+ | **Version** | `3.4.0` |
82
+ | **spaCy** | `>=3.4.0,<3.5.0` |
83
  | **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `attribute_ruler`, `ner` |
84
  | **Components** | `tok2vec`, `morphologizer`, `parser`, `senter`, `attribute_ruler`, `ner` |
85
  | **Vectors** | 480443 keys, 480443 unique vectors (300 dimensions) |
 
91
 
92
  <details>
93
 
94
+ <summary>View label scheme (65 labels for 3 components)</summary>
95
 
96
  | Component | Labels |
97
  | --- | --- |
98
+ | **`morphologizer`** | `POS=NOUN`, `POS=ADP`, `POS=VERB`, `POS=SCONJ`, `POS=AUX`, `POS=PUNCT`, `POS=PART`, `POS=DET`, `POS=NUM`, `POS=ADV`, `POS=PRON`, `POS=ADJ`, `POS=PROPN`, `POS=CCONJ`, `POS=SYM`, `POS=NOUN\|Polarity=Neg`, `POS=AUX\|Polarity=Neg`, `POS=SPACE`, `POS=INTJ`, `POS=SCONJ\|Polarity=Neg` |
99
  | **`parser`** | `ROOT`, `acl`, `advcl`, `advmod`, `amod`, `aux`, `case`, `cc`, `ccomp`, `compound`, `cop`, `csubj`, `dep`, `det`, `dislocated`, `fixed`, `mark`, `nmod`, `nsubj`, `nummod`, `obj`, `obl`, `punct` |
100
  | **`ner`** | `CARDINAL`, `DATE`, `EVENT`, `FAC`, `GPE`, `LANGUAGE`, `LAW`, `LOC`, `MONEY`, `MOVEMENT`, `NORP`, `ORDINAL`, `ORG`, `PERCENT`, `PERSON`, `PET_NAME`, `PHONE`, `PRODUCT`, `QUANTITY`, `TIME`, `TITLE_AFFIX`, `WORK_OF_ART` |
101
 
 
109
  | `TOKEN_P` | 97.65 |
110
  | `TOKEN_R` | 97.90 |
111
  | `TOKEN_F` | 97.77 |
112
+ | `POS_ACC` | 97.37 |
113
  | `MORPH_ACC` | 0.00 |
114
  | `MORPH_MICRO_P` | 34.01 |
115
  | `MORPH_MICRO_R` | 98.04 |
116
  | `MORPH_MICRO_F` | 50.51 |
117
+ | `SENTS_P` | 99.41 |
118
+ | `SENTS_R` | 99.21 |
119
+ | `SENTS_F` | 99.31 |
120
+ | `DEP_UAS` | 92.17 |
121
+ | `DEP_LAS` | 90.91 |
122
  | `TAG_ACC` | 97.12 |
123
+ | `LEMMA_ACC` | 96.71 |
124
+ | `ENTS_P` | 74.36 |
125
+ | `ENTS_R` | 69.69 |
126
+ | `ENTS_F` | 71.95 |
accuracy.json CHANGED
@@ -3,7 +3,7 @@
3
  "token_p": 0.9764591282,
4
  "token_r": 0.9790021974,
5
  "token_f": 0.9777290092,
6
- "pos_acc": 0.9745981102,
7
  "morph_acc": 0.0,
8
  "morph_micro_p": 0.3401360544,
9
  "morph_micro_r": 0.9803921569,
@@ -25,106 +25,106 @@
25
  "f": 0.0
26
  }
27
  },
28
- "sents_p": 0.9823874755,
29
- "sents_r": 0.9901380671,
30
- "sents_f": 0.9862475442,
31
- "dep_uas": 0.9222457341,
32
- "dep_las": 0.9090090901,
33
  "dep_las_per_type": {
34
  "cc": {
35
- "p": 0.7755102041,
36
- "r": 0.7916666667,
37
- "f": 0.7835051546
38
  },
39
  "compound": {
40
- "p": 0.9439906651,
41
- "r": 0.9120631342,
42
- "f": 0.9277522936
43
  },
44
  "obl": {
45
- "p": 0.8172715895,
46
- "r": 0.8152309613,
47
- "f": 0.81625
48
  },
49
  "case": {
50
- "p": 0.9900230238,
51
- "r": 0.9802431611,
52
- "f": 0.9851088202
53
  },
54
  "dislocated": {
55
- "p": 0.7,
56
  "r": 0.5384615385,
57
- "f": 0.6086956522
58
  },
59
  "nsubj": {
60
- "p": 0.8349514563,
61
- "r": 0.8253358925,
62
- "f": 0.8301158301
63
  },
64
  "nmod": {
65
- "p": 0.8793532338,
66
- "r": 0.8269005848,
67
- "f": 0.8523206751
68
  },
69
  "root": {
70
- "p": 0.958250497,
71
- "r": 0.9506903353,
72
- "f": 0.9544554455
73
  },
74
  "aux": {
75
- "p": 0.9851301115,
76
  "r": 0.9842154132,
77
- "f": 0.9846725499
78
  },
79
  "advcl": {
80
- "p": 0.693877551,
81
- "r": 0.6876404494,
82
- "f": 0.690744921
83
  },
84
  "mark": {
85
- "p": 0.9775510204,
86
- "r": 0.958,
87
- "f": 0.9676767677
88
  },
89
  "fixed": {
90
- "p": 0.9536541889,
91
- "r": 0.9727272727,
92
- "f": 0.9630963096
93
  },
94
  "acl": {
95
- "p": 0.8409586057,
96
- "r": 0.8483516484,
97
- "f": 0.8446389497
98
  },
99
  "obj": {
100
- "p": 0.9541284404,
101
- "r": 0.9425981873,
102
- "f": 0.9483282675
103
  },
104
  "nummod": {
105
- "p": 0.987012987,
106
- "r": 0.899408284,
107
- "f": 0.9411764706
108
  },
109
  "advmod": {
110
- "p": 0.6904761905,
111
- "r": 0.6214285714,
112
- "f": 0.6541353383
113
  },
114
  "amod": {
115
- "p": 0.962962963,
116
- "r": 0.7027027027,
117
- "f": 0.8125
118
  },
119
  "cop": {
120
- "p": 0.9534883721,
121
- "r": 0.9534883721,
122
- "f": 0.9534883721
123
  },
124
  "ccomp": {
125
- "p": 0.68,
126
- "r": 0.7727272727,
127
- "f": 0.7234042553
128
  },
129
  "det": {
130
  "p": 1.0,
@@ -132,9 +132,9 @@
132
  "f": 0.9904761905
133
  },
134
  "csubj": {
135
- "p": 0.6923076923,
136
- "r": 0.75,
137
- "f": 0.72
138
  },
139
  "dep": {
140
  "p": 0.0,
@@ -143,65 +143,70 @@
143
  }
144
  },
145
  "tag_acc": 0.9712488769,
146
- "lemma_acc": 0.965013864,
147
- "ents_p": 0.7611940299,
148
- "ents_r": 0.7056603774,
149
- "ents_f": 0.7323759791,
150
  "ents_per_type": {
151
  "DATE": {
152
- "p": 0.9541284404,
153
- "r": 0.9541284404,
154
- "f": 0.9541284404
155
  },
156
  "ORG": {
157
- "p": 0.6639344262,
158
- "r": 0.5912408759,
159
- "f": 0.6254826255
160
  },
161
  "PERSON": {
162
- "p": 0.7714285714,
163
- "r": 0.7769784173,
164
- "f": 0.7741935484
165
  },
166
  "GPE": {
167
- "p": 0.7272727273,
168
  "r": 0.6808510638,
169
- "f": 0.7032967033
170
  },
171
  "PRODUCT": {
172
- "p": 0.5,
173
- "r": 0.4047619048,
174
- "f": 0.4473684211
175
  },
176
  "TIME": {
177
- "p": 0.5714285714,
178
  "r": 1.0,
179
- "f": 0.7272727273
180
  },
181
  "QUANTITY": {
182
- "p": 0.884057971,
183
- "r": 0.9242424242,
184
- "f": 0.9037037037
185
  },
186
  "NORP": {
187
- "p": 0.8,
188
  "r": 0.625,
189
- "f": 0.701754386
190
  },
191
  "ORDINAL": {
192
- "p": 0.7,
193
- "r": 0.6363636364,
194
  "f": 0.6666666667
195
  },
196
  "TITLE_AFFIX": {
197
- "p": 0.7407407407,
198
- "r": 0.6666666667,
199
- "f": 0.701754386
200
  },
201
  "WORK_OF_ART": {
202
- "p": 0.8571428571,
203
- "r": 0.7058823529,
204
- "f": 0.7741935484
 
 
 
 
 
205
  },
206
  "PERCENT": {
207
  "p": 1.0,
@@ -209,24 +214,19 @@
209
  "f": 0.4444444444
210
  },
211
  "EVENT": {
212
- "p": 0.75,
213
- "r": 0.6923076923,
214
- "f": 0.72
215
- },
216
- "CARDINAL": {
217
- "p": 0.0,
218
- "r": 0.0,
219
- "f": 0.0
220
  },
221
  "LOC": {
222
- "p": 0.5,
223
- "r": 0.8,
224
- "f": 0.6153846154
225
  },
226
  "FAC": {
227
- "p": 0.6666666667,
228
- "r": 0.3783783784,
229
- "f": 0.4827586207
230
  },
231
  "MOVEMENT": {
232
  "p": 0.0,
@@ -238,11 +238,6 @@
238
  "r": 0.3333333333,
239
  "f": 0.5
240
  },
241
- "PET_NAME": {
242
- "p": 0.0,
243
- "r": 0.0,
244
- "f": 0.0
245
- },
246
  "MONEY": {
247
  "p": 1.0,
248
  "r": 1.0,
@@ -254,5 +249,5 @@
254
  "f": 1.0
255
  }
256
  },
257
- "speed": 9177.2419617522
258
  }
 
3
  "token_p": 0.9764591282,
4
  "token_r": 0.9790021974,
5
  "token_f": 0.9777290092,
6
+ "pos_acc": 0.9736540664,
7
  "morph_acc": 0.0,
8
  "morph_micro_p": 0.3401360544,
9
  "morph_micro_r": 0.9803921569,
 
25
  "f": 0.0
26
  }
27
  },
28
+ "sents_p": 0.9940711462,
29
+ "sents_r": 0.9921104536,
30
+ "sents_f": 0.9930898322,
31
+ "dep_uas": 0.9216710183,
32
+ "dep_las": 0.909074549,
33
  "dep_las_per_type": {
34
  "cc": {
35
+ "p": 0.7446808511,
36
+ "r": 0.7291666667,
37
+ "f": 0.7368421053
38
  },
39
  "compound": {
40
+ "p": 0.9409038239,
41
+ "r": 0.9154453213,
42
+ "f": 0.928
43
  },
44
  "obl": {
45
+ "p": 0.8226415094,
46
+ "r": 0.8164794007,
47
+ "f": 0.8195488722
48
  },
49
  "case": {
50
+ "p": 0.9885013415,
51
+ "r": 0.9798632219,
52
+ "f": 0.9841633276
53
  },
54
  "dislocated": {
55
+ "p": 0.5833333333,
56
  "r": 0.5384615385,
57
+ "f": 0.56
58
  },
59
  "nsubj": {
60
+ "p": 0.7976878613,
61
+ "r": 0.7946257198,
62
+ "f": 0.7961538462
63
  },
64
  "nmod": {
65
+ "p": 0.885,
66
+ "r": 0.8280701754,
67
+ "f": 0.8555891239
68
  },
69
  "root": {
70
+ "p": 0.9639278557,
71
+ "r": 0.9487179487,
72
+ "f": 0.9562624254
73
  },
74
  "aux": {
75
+ "p": 0.9787626962,
76
  "r": 0.9842154132,
77
+ "f": 0.9814814815
78
  },
79
  "advcl": {
80
+ "p": 0.7214285714,
81
+ "r": 0.6808988764,
82
+ "f": 0.7005780347
83
  },
84
  "mark": {
85
+ "p": 0.9755102041,
86
+ "r": 0.956,
87
+ "f": 0.9656565657
88
  },
89
  "fixed": {
90
+ "p": 0.9534883721,
91
+ "r": 0.9690909091,
92
+ "f": 0.96122633
93
  },
94
  "acl": {
95
+ "p": 0.8394004283,
96
+ "r": 0.8615384615,
97
+ "f": 0.8503253796
98
  },
99
  "obj": {
100
+ "p": 0.9542682927,
101
+ "r": 0.9456193353,
102
+ "f": 0.9499241275
103
  },
104
  "nummod": {
105
+ "p": 0.9444444444,
106
+ "r": 0.9053254438,
107
+ "f": 0.9244712991
108
  },
109
  "advmod": {
110
+ "p": 0.7050359712,
111
+ "r": 0.7,
112
+ "f": 0.7025089606
113
  },
114
  "amod": {
115
+ "p": 0.9032258065,
116
+ "r": 0.7567567568,
117
+ "f": 0.8235294118
118
  },
119
  "cop": {
120
+ "p": 0.9644970414,
121
+ "r": 0.9476744186,
122
+ "f": 0.9560117302
123
  },
124
  "ccomp": {
125
+ "p": 1.0,
126
+ "r": 0.9090909091,
127
+ "f": 0.9523809524
128
  },
129
  "det": {
130
  "p": 1.0,
 
132
  "f": 0.9904761905
133
  },
134
  "csubj": {
135
+ "p": 0.6153846154,
136
+ "r": 0.6666666667,
137
+ "f": 0.64
138
  },
139
  "dep": {
140
  "p": 0.0,
 
143
  }
144
  },
145
  "tag_acc": 0.9712488769,
146
+ "lemma_acc": 0.9670526831,
147
+ "ents_p": 0.7436241611,
148
+ "ents_r": 0.6968553459,
149
+ "ents_f": 0.7194805195,
150
  "ents_per_type": {
151
  "DATE": {
152
+ "p": 0.9633027523,
153
+ "r": 0.9633027523,
154
+ "f": 0.9633027523
155
  },
156
  "ORG": {
157
+ "p": 0.6363636364,
158
+ "r": 0.5620437956,
159
+ "f": 0.5968992248
160
  },
161
  "PERSON": {
162
+ "p": 0.7315436242,
163
+ "r": 0.7841726619,
164
+ "f": 0.7569444444
165
  },
166
  "GPE": {
167
+ "p": 0.7032967033,
168
  "r": 0.6808510638,
169
+ "f": 0.6918918919
170
  },
171
  "PRODUCT": {
172
+ "p": 0.4642857143,
173
+ "r": 0.3095238095,
174
+ "f": 0.3714285714
175
  },
176
  "TIME": {
177
+ "p": 0.6666666667,
178
  "r": 1.0,
179
+ "f": 0.8
180
  },
181
  "QUANTITY": {
182
+ "p": 0.8450704225,
183
+ "r": 0.9090909091,
184
+ "f": 0.8759124088
185
  },
186
  "NORP": {
187
+ "p": 0.6896551724,
188
  "r": 0.625,
189
+ "f": 0.6557377049
190
  },
191
  "ORDINAL": {
192
+ "p": 0.652173913,
193
+ "r": 0.6818181818,
194
  "f": 0.6666666667
195
  },
196
  "TITLE_AFFIX": {
197
+ "p": 0.8888888889,
198
+ "r": 0.5333333333,
199
+ "f": 0.6666666667
200
  },
201
  "WORK_OF_ART": {
202
+ "p": 0.625,
203
+ "r": 0.5882352941,
204
+ "f": 0.6060606061
205
+ },
206
+ "CARDINAL": {
207
+ "p": 1.0,
208
+ "r": 0.5,
209
+ "f": 0.6666666667
210
  },
211
  "PERCENT": {
212
  "p": 1.0,
 
214
  "f": 0.4444444444
215
  },
216
  "EVENT": {
217
+ "p": 0.6956521739,
218
+ "r": 0.6153846154,
219
+ "f": 0.6530612245
 
 
 
 
 
220
  },
221
  "LOC": {
222
+ "p": 0.6428571429,
223
+ "r": 0.9,
224
+ "f": 0.75
225
  },
226
  "FAC": {
227
+ "p": 0.6785714286,
228
+ "r": 0.5135135135,
229
+ "f": 0.5846153846
230
  },
231
  "MOVEMENT": {
232
  "p": 0.0,
 
238
  "r": 0.3333333333,
239
  "f": 0.5
240
  },
 
 
 
 
 
241
  "MONEY": {
242
  "p": 1.0,
243
  "r": 1.0,
 
249
  "f": 1.0
250
  }
251
  },
252
+ "speed": 9891.9644910527
253
  }
ja_core_news_lg-any-py3-none-any.whl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2e41957fc0c8fbf0593d39b975c6cf36a4742dfb7d00b2c4b48161814907db28
3
- size 555135908
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeadec83e6f3149cf6681d6ad45a6f17f408a82914e8f16c50909e848844569b
3
+ size 555132558
meta.json CHANGED
@@ -1,14 +1,14 @@
1
  {
2
  "lang":"ja",
3
  "name":"core_news_lg",
4
- "version":"3.3.0",
5
  "description":"Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler.",
6
  "author":"Explosion",
7
  "email":"contact@explosion.ai",
8
  "url":"https://explosion.ai",
9
  "license":"CC BY-SA 4.0",
10
- "spacy_version":">=3.3.0.dev0,<3.4.0",
11
- "spacy_git_version":"849bef2de",
12
  "vectors":{
13
  "width":300,
14
  "vectors":480443,
@@ -37,6 +37,7 @@
37
  "POS=SYM",
38
  "POS=NOUN|Polarity=Neg",
39
  "POS=AUX|Polarity=Neg",
 
40
  "POS=INTJ",
41
  "POS=SCONJ|Polarity=Neg"
42
  ],
@@ -116,7 +117,7 @@
116
  "token_p":0.9764591282,
117
  "token_r":0.9790021974,
118
  "token_f":0.9777290092,
119
- "pos_acc":0.9745981102,
120
  "morph_acc":0.0,
121
  "morph_micro_p":0.3401360544,
122
  "morph_micro_r":0.9803921569,
@@ -138,106 +139,106 @@
138
  "f":0.0
139
  }
140
  },
141
- "sents_p":0.9823874755,
142
- "sents_r":0.9901380671,
143
- "sents_f":0.9862475442,
144
- "dep_uas":0.9222457341,
145
- "dep_las":0.9090090901,
146
  "dep_las_per_type":{
147
  "cc":{
148
- "p":0.7755102041,
149
- "r":0.7916666667,
150
- "f":0.7835051546
151
  },
152
  "compound":{
153
- "p":0.9439906651,
154
- "r":0.9120631342,
155
- "f":0.9277522936
156
  },
157
  "obl":{
158
- "p":0.8172715895,
159
- "r":0.8152309613,
160
- "f":0.81625
161
  },
162
  "case":{
163
- "p":0.9900230238,
164
- "r":0.9802431611,
165
- "f":0.9851088202
166
  },
167
  "dislocated":{
168
- "p":0.7,
169
  "r":0.5384615385,
170
- "f":0.6086956522
171
  },
172
  "nsubj":{
173
- "p":0.8349514563,
174
- "r":0.8253358925,
175
- "f":0.8301158301
176
  },
177
  "nmod":{
178
- "p":0.8793532338,
179
- "r":0.8269005848,
180
- "f":0.8523206751
181
  },
182
  "root":{
183
- "p":0.958250497,
184
- "r":0.9506903353,
185
- "f":0.9544554455
186
  },
187
  "aux":{
188
- "p":0.9851301115,
189
  "r":0.9842154132,
190
- "f":0.9846725499
191
  },
192
  "advcl":{
193
- "p":0.693877551,
194
- "r":0.6876404494,
195
- "f":0.690744921
196
  },
197
  "mark":{
198
- "p":0.9775510204,
199
- "r":0.958,
200
- "f":0.9676767677
201
  },
202
  "fixed":{
203
- "p":0.9536541889,
204
- "r":0.9727272727,
205
- "f":0.9630963096
206
  },
207
  "acl":{
208
- "p":0.8409586057,
209
- "r":0.8483516484,
210
- "f":0.8446389497
211
  },
212
  "obj":{
213
- "p":0.9541284404,
214
- "r":0.9425981873,
215
- "f":0.9483282675
216
  },
217
  "nummod":{
218
- "p":0.987012987,
219
- "r":0.899408284,
220
- "f":0.9411764706
221
  },
222
  "advmod":{
223
- "p":0.6904761905,
224
- "r":0.6214285714,
225
- "f":0.6541353383
226
  },
227
  "amod":{
228
- "p":0.962962963,
229
- "r":0.7027027027,
230
- "f":0.8125
231
  },
232
  "cop":{
233
- "p":0.9534883721,
234
- "r":0.9534883721,
235
- "f":0.9534883721
236
  },
237
  "ccomp":{
238
- "p":0.68,
239
- "r":0.7727272727,
240
- "f":0.7234042553
241
  },
242
  "det":{
243
  "p":1.0,
@@ -245,9 +246,9 @@
245
  "f":0.9904761905
246
  },
247
  "csubj":{
248
- "p":0.6923076923,
249
- "r":0.75,
250
- "f":0.72
251
  },
252
  "dep":{
253
  "p":0.0,
@@ -256,65 +257,70 @@
256
  }
257
  },
258
  "tag_acc":0.9712488769,
259
- "lemma_acc":0.965013864,
260
- "ents_p":0.7611940299,
261
- "ents_r":0.7056603774,
262
- "ents_f":0.7323759791,
263
  "ents_per_type":{
264
  "DATE":{
265
- "p":0.9541284404,
266
- "r":0.9541284404,
267
- "f":0.9541284404
268
  },
269
  "ORG":{
270
- "p":0.6639344262,
271
- "r":0.5912408759,
272
- "f":0.6254826255
273
  },
274
  "PERSON":{
275
- "p":0.7714285714,
276
- "r":0.7769784173,
277
- "f":0.7741935484
278
  },
279
  "GPE":{
280
- "p":0.7272727273,
281
  "r":0.6808510638,
282
- "f":0.7032967033
283
  },
284
  "PRODUCT":{
285
- "p":0.5,
286
- "r":0.4047619048,
287
- "f":0.4473684211
288
  },
289
  "TIME":{
290
- "p":0.5714285714,
291
  "r":1.0,
292
- "f":0.7272727273
293
  },
294
  "QUANTITY":{
295
- "p":0.884057971,
296
- "r":0.9242424242,
297
- "f":0.9037037037
298
  },
299
  "NORP":{
300
- "p":0.8,
301
  "r":0.625,
302
- "f":0.701754386
303
  },
304
  "ORDINAL":{
305
- "p":0.7,
306
- "r":0.6363636364,
307
  "f":0.6666666667
308
  },
309
  "TITLE_AFFIX":{
310
- "p":0.7407407407,
311
- "r":0.6666666667,
312
- "f":0.701754386
313
  },
314
  "WORK_OF_ART":{
315
- "p":0.8571428571,
316
- "r":0.7058823529,
317
- "f":0.7741935484
 
 
 
 
 
318
  },
319
  "PERCENT":{
320
  "p":1.0,
@@ -322,24 +328,19 @@
322
  "f":0.4444444444
323
  },
324
  "EVENT":{
325
- "p":0.75,
326
- "r":0.6923076923,
327
- "f":0.72
328
- },
329
- "CARDINAL":{
330
- "p":0.0,
331
- "r":0.0,
332
- "f":0.0
333
  },
334
  "LOC":{
335
- "p":0.5,
336
- "r":0.8,
337
- "f":0.6153846154
338
  },
339
  "FAC":{
340
- "p":0.6666666667,
341
- "r":0.3783783784,
342
- "f":0.4827586207
343
  },
344
  "MOVEMENT":{
345
  "p":0.0,
@@ -351,11 +352,6 @@
351
  "r":0.3333333333,
352
  "f":0.5
353
  },
354
- "PET_NAME":{
355
- "p":0.0,
356
- "r":0.0,
357
- "f":0.0
358
- },
359
  "MONEY":{
360
  "p":1.0,
361
  "r":1.0,
@@ -367,7 +363,7 @@
367
  "f":1.0
368
  }
369
  },
370
- "speed":9177.2419617522
371
  },
372
  "sources":[
373
  {
 
1
  {
2
  "lang":"ja",
3
  "name":"core_news_lg",
4
+ "version":"3.4.0",
5
  "description":"Japanese pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler.",
6
  "author":"Explosion",
7
  "email":"contact@explosion.ai",
8
  "url":"https://explosion.ai",
9
  "license":"CC BY-SA 4.0",
10
+ "spacy_version":">=3.4.0,<3.5.0",
11
+ "spacy_git_version":"dd038b536",
12
  "vectors":{
13
  "width":300,
14
  "vectors":480443,
 
37
  "POS=SYM",
38
  "POS=NOUN|Polarity=Neg",
39
  "POS=AUX|Polarity=Neg",
40
+ "POS=SPACE",
41
  "POS=INTJ",
42
  "POS=SCONJ|Polarity=Neg"
43
  ],
 
117
  "token_p":0.9764591282,
118
  "token_r":0.9790021974,
119
  "token_f":0.9777290092,
120
+ "pos_acc":0.9736540664,
121
  "morph_acc":0.0,
122
  "morph_micro_p":0.3401360544,
123
  "morph_micro_r":0.9803921569,
 
139
  "f":0.0
140
  }
141
  },
142
+ "sents_p":0.9940711462,
143
+ "sents_r":0.9921104536,
144
+ "sents_f":0.9930898322,
145
+ "dep_uas":0.9216710183,
146
+ "dep_las":0.909074549,
147
  "dep_las_per_type":{
148
  "cc":{
149
+ "p":0.7446808511,
150
+ "r":0.7291666667,
151
+ "f":0.7368421053
152
  },
153
  "compound":{
154
+ "p":0.9409038239,
155
+ "r":0.9154453213,
156
+ "f":0.928
157
  },
158
  "obl":{
159
+ "p":0.8226415094,
160
+ "r":0.8164794007,
161
+ "f":0.8195488722
162
  },
163
  "case":{
164
+ "p":0.9885013415,
165
+ "r":0.9798632219,
166
+ "f":0.9841633276
167
  },
168
  "dislocated":{
169
+ "p":0.5833333333,
170
  "r":0.5384615385,
171
+ "f":0.56
172
  },
173
  "nsubj":{
174
+ "p":0.7976878613,
175
+ "r":0.7946257198,
176
+ "f":0.7961538462
177
  },
178
  "nmod":{
179
+ "p":0.885,
180
+ "r":0.8280701754,
181
+ "f":0.8555891239
182
  },
183
  "root":{
184
+ "p":0.9639278557,
185
+ "r":0.9487179487,
186
+ "f":0.9562624254
187
  },
188
  "aux":{
189
+ "p":0.9787626962,
190
  "r":0.9842154132,
191
+ "f":0.9814814815
192
  },
193
  "advcl":{
194
+ "p":0.7214285714,
195
+ "r":0.6808988764,
196
+ "f":0.7005780347
197
  },
198
  "mark":{
199
+ "p":0.9755102041,
200
+ "r":0.956,
201
+ "f":0.9656565657
202
  },
203
  "fixed":{
204
+ "p":0.9534883721,
205
+ "r":0.9690909091,
206
+ "f":0.96122633
207
  },
208
  "acl":{
209
+ "p":0.8394004283,
210
+ "r":0.8615384615,
211
+ "f":0.8503253796
212
  },
213
  "obj":{
214
+ "p":0.9542682927,
215
+ "r":0.9456193353,
216
+ "f":0.9499241275
217
  },
218
  "nummod":{
219
+ "p":0.9444444444,
220
+ "r":0.9053254438,
221
+ "f":0.9244712991
222
  },
223
  "advmod":{
224
+ "p":0.7050359712,
225
+ "r":0.7,
226
+ "f":0.7025089606
227
  },
228
  "amod":{
229
+ "p":0.9032258065,
230
+ "r":0.7567567568,
231
+ "f":0.8235294118
232
  },
233
  "cop":{
234
+ "p":0.9644970414,
235
+ "r":0.9476744186,
236
+ "f":0.9560117302
237
  },
238
  "ccomp":{
239
+ "p":1.0,
240
+ "r":0.9090909091,
241
+ "f":0.9523809524
242
  },
243
  "det":{
244
  "p":1.0,
 
246
  "f":0.9904761905
247
  },
248
  "csubj":{
249
+ "p":0.6153846154,
250
+ "r":0.6666666667,
251
+ "f":0.64
252
  },
253
  "dep":{
254
  "p":0.0,
 
257
  }
258
  },
259
  "tag_acc":0.9712488769,
260
+ "lemma_acc":0.9670526831,
261
+ "ents_p":0.7436241611,
262
+ "ents_r":0.6968553459,
263
+ "ents_f":0.7194805195,
264
  "ents_per_type":{
265
  "DATE":{
266
+ "p":0.9633027523,
267
+ "r":0.9633027523,
268
+ "f":0.9633027523
269
  },
270
  "ORG":{
271
+ "p":0.6363636364,
272
+ "r":0.5620437956,
273
+ "f":0.5968992248
274
  },
275
  "PERSON":{
276
+ "p":0.7315436242,
277
+ "r":0.7841726619,
278
+ "f":0.7569444444
279
  },
280
  "GPE":{
281
+ "p":0.7032967033,
282
  "r":0.6808510638,
283
+ "f":0.6918918919
284
  },
285
  "PRODUCT":{
286
+ "p":0.4642857143,
287
+ "r":0.3095238095,
288
+ "f":0.3714285714
289
  },
290
  "TIME":{
291
+ "p":0.6666666667,
292
  "r":1.0,
293
+ "f":0.8
294
  },
295
  "QUANTITY":{
296
+ "p":0.8450704225,
297
+ "r":0.9090909091,
298
+ "f":0.8759124088
299
  },
300
  "NORP":{
301
+ "p":0.6896551724,
302
  "r":0.625,
303
+ "f":0.6557377049
304
  },
305
  "ORDINAL":{
306
+ "p":0.652173913,
307
+ "r":0.6818181818,
308
  "f":0.6666666667
309
  },
310
  "TITLE_AFFIX":{
311
+ "p":0.8888888889,
312
+ "r":0.5333333333,
313
+ "f":0.6666666667
314
  },
315
  "WORK_OF_ART":{
316
+ "p":0.625,
317
+ "r":0.5882352941,
318
+ "f":0.6060606061
319
+ },
320
+ "CARDINAL":{
321
+ "p":1.0,
322
+ "r":0.5,
323
+ "f":0.6666666667
324
  },
325
  "PERCENT":{
326
  "p":1.0,
 
328
  "f":0.4444444444
329
  },
330
  "EVENT":{
331
+ "p":0.6956521739,
332
+ "r":0.6153846154,
333
+ "f":0.6530612245
 
 
 
 
 
334
  },
335
  "LOC":{
336
+ "p":0.6428571429,
337
+ "r":0.9,
338
+ "f":0.75
339
  },
340
  "FAC":{
341
+ "p":0.6785714286,
342
+ "r":0.5135135135,
343
+ "f":0.5846153846
344
  },
345
  "MOVEMENT":{
346
  "p":0.0,
 
352
  "r":0.3333333333,
353
  "f":0.5
354
  },
 
 
 
 
 
355
  "MONEY":{
356
  "p":1.0,
357
  "r":1.0,
 
363
  "f":1.0
364
  }
365
  },
366
+ "speed":9891.9644910527
367
  },
368
  "sources":[
369
  {
morphologizer/cfg CHANGED
@@ -18,6 +18,7 @@
18
  "POS=SYM":"",
19
  "POS=NOUN|Polarity=Neg":"Polarity=Neg",
20
  "POS=AUX|Polarity=Neg":"Polarity=Neg",
 
21
  "POS=INTJ":"",
22
  "POS=SCONJ|Polarity=Neg":"Polarity=Neg"
23
  },
@@ -39,6 +40,7 @@
39
  "POS=SYM":99,
40
  "POS=NOUN|Polarity=Neg":92,
41
  "POS=AUX|Polarity=Neg":87,
 
42
  "POS=INTJ":91,
43
  "POS=SCONJ|Polarity=Neg":98
44
  },
 
18
  "POS=SYM":"",
19
  "POS=NOUN|Polarity=Neg":"Polarity=Neg",
20
  "POS=AUX|Polarity=Neg":"Polarity=Neg",
21
+ "POS=SPACE":"",
22
  "POS=INTJ":"",
23
  "POS=SCONJ|Polarity=Neg":"Polarity=Neg"
24
  },
 
40
  "POS=SYM":99,
41
  "POS=NOUN|Polarity=Neg":92,
42
  "POS=AUX|Polarity=Neg":87,
43
+ "POS=SPACE":103,
44
  "POS=INTJ":91,
45
  "POS=SCONJ|Polarity=Neg":98
46
  },
morphologizer/model CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c1f0b2cd0b894e6aa09768e067626f87db1a3494320d0414220996ac0bea727
3
- size 7801
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbbfd40357eab805068ad2c122868ae1521b26385451d5982098131df73e1c4a
3
+ size 8189
ner/model CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9684ef4a41de356943352cd296fb2b49e30f4312fb040ff425fa0a9f3e8cd4b7
3
  size 6385103
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e2dd08ef000cc5679017a8451868efee89bf05da3c90813f9bc53b1c9c890a3
3
  size 6385103
ner/moves CHANGED
@@ -1 +1 @@
1
- ��moves��{"0":{},"1":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"2":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"3":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"4":{"DATE":4200,"ORG":3487,"PERSON":3042,"QUANTITY":2519,"GPE":1953,"PRODUCT":1328,"FAC":1243,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":734,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4,"":1},"5":{"":1}}�cfg��neg_key�
 
1
+ ��moves��{"0":{},"1":{"DATE":4200,"ORG":3488,"PERSON":3043,"QUANTITY":2521,"GPE":1953,"PRODUCT":1328,"FAC":1244,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":735,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"2":{"DATE":4200,"ORG":3488,"PERSON":3043,"QUANTITY":2521,"GPE":1953,"PRODUCT":1328,"FAC":1244,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":735,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"3":{"DATE":4200,"ORG":3488,"PERSON":3043,"QUANTITY":2521,"GPE":1953,"PRODUCT":1328,"FAC":1244,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":735,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4},"4":{"DATE":4200,"ORG":3488,"PERSON":3043,"QUANTITY":2521,"GPE":1953,"PRODUCT":1328,"FAC":1244,"ORDINAL":1114,"WORK_OF_ART":1053,"EVENT":869,"NORP":735,"LOC":563,"MONEY":400,"TITLE_AFFIX":344,"TIME":300,"PERCENT":274,"MOVEMENT":148,"LAW":94,"LANGUAGE":82,"CARDINAL":27,"PET_NAME":20,"PHONE":4,"":1},"5":{"":1}}�cfg��neg_key�
parser/model CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9f68fccc840e9dbe4f062ad83ec768c7e3075d99751ae5d913de770613b73677
3
  size 299888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbbb3300c6325678be6044298cb4985ab676413b0f84db6128ca13835e2d9e58
3
  size 299888
parser/moves CHANGED
@@ -1 +1 @@
1
- ��moves�~{"0":{"":77992},"1":{"":83293},"2":{"compound":23506,"nmod":11446,"obl":11030,"nsubj":6884,"advcl":6063,"acl":6020,"obj":4629,"nummod":2487,"advmod":1922,"punct":1321,"det":830,"cc":726,"amod":372,"ccomp":325,"dislocated":235,"csubj":133,"dep":0},"3":{"case":35913,"punct":15455,"aux":14940,"fixed":7391,"mark":6644,"cop":2100,"compound":598,"advcl":152,"dep":58},"4":{"ROOT":7050}}�cfg��neg_key�
 
1
+ ��moves�{"0":{"":77992},"1":{"":83431},"2":{"compound":23506,"nmod":11446,"obl":11030,"nsubj":6884,"advcl":6063,"acl":6020,"obj":4629,"nummod":2487,"advmod":1922,"punct":1321,"det":830,"cc":726,"amod":372,"ccomp":325,"dislocated":235,"csubj":133,"dep":0},"3":{"case":35913,"punct":15455,"aux":14940,"fixed":7391,"mark":6644,"cop":2100,"compound":598,"dep":196,"advcl":152},"4":{"ROOT":7050}}�cfg��neg_key�
senter/model CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d03c1c3d77a449456e344f49ecdbadf6265700d553876929c382bb7f762f746e
3
  size 213263
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1888c028fac6a14d5e59d18b845a4e2333018c7f8fde61b8c9185ca50f8aea0
3
  size 213263
tok2vec/model CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff4955abec8fdefd6a93e0788a840101803222fde3f0c181d078b3c1adadbc1c
3
  size 6235418
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7fa4187a19ff2bf9bf2043204e3acf5d0f0ccee3964029570037b22983e6ae0
3
  size 6235418
vocab/key2row CHANGED
Binary files a/vocab/key2row and b/vocab/key2row differ
 
vocab/strings.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9993f3e45abd60896e44b374466400eb1ab3c1a8399fb4432cff07ec6c698a24
3
- size 15614088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f46ad81d5dcd705544d572cb570cd08ddec29afc94133401d3353319ce27a234
3
+ size 15615980