Update spaCy pipeline

.gitattributes

@@ -19,3 +19,4 @@
 *strings.json filter=lfs diff=lfs merge=lfs -text
 vectors filter=lfs diff=lfs merge=lfs -text
 model filter=lfs diff=lfs merge=lfs -text
+*key2row filter=lfs diff=lfs merge=lfs -text

LICENSES_SOURCES

@@ -878,557 +878,6 @@ Creative Commons may be contacted at creativecommons.org.
 
 
 
-# Lemmatization Lists
-
-* Author: Michal Měchura
-* URL: https://github.com/michmech/lemmatization-lists/
-* License: ODbL
-
-```
-## ODC Open Database License (ODbL)
-
-### Preamble
-
-The Open Database License (ODbL) is a license agreement intended to
-allow users to freely share, modify, and use this Database while
-maintaining this same freedom for others. Many databases are covered by
-copyright, and therefore this document licenses these rights. Some
-jurisdictions, mainly in the European Union, have specific rights that
-cover databases, and so the ODbL addresses these rights, too. Finally,
-the ODbL is also an agreement in contract for users of this Database to
-act in certain ways in return for accessing this Database.
-
-Databases can contain a wide variety of types of content (images,
-audiovisual material, and sounds all in the same database, for example),
-and so the ODbL only governs the rights over the Database, and not the
-contents of the Database individually. Licensors should use the ODbL
-together with another license for the contents, if the contents have a
-single set of rights that uniformly covers all of the contents. If the
-contents have multiple sets of different rights, Licensors should
-describe what rights govern what contents together in the individual
-record or in some other way that clarifies what rights apply. 
-
-Sometimes the contents of a database, or the database itself, can be
-covered by other rights not addressed here (such as private contracts,
-trade mark over the name, or privacy rights / data protection rights
-over information in the contents), and so you are advised that you may
-have to consult other documents or clear other rights before doing
-activities not covered by this License.
-
-------
-
-The Licensor (as defined below) 
-
-and 
-
-You (as defined below) 
-
-agree as follows: 
-
-### 1.0 Definitions of Capitalised Words
-
-"Collective Database" – Means this Database in unmodified form as part
-of a collection of independent databases in themselves that together are
-assembled into a collective whole. A work that constitutes a Collective
-Database will not be considered a Derivative Database.
-
-"Convey" – As a verb, means Using the Database, a Derivative Database,
-or the Database as part of a Collective Database in any way that enables
-a Person to make or receive copies of the Database or a Derivative
-Database.  Conveying does not include interaction with a user through a
-computer network, or creating and Using a Produced Work, where no
-transfer of a copy of the Database or a Derivative Database occurs.
-"Contents" – The contents of this Database, which includes the
-information, independent works, or other material collected into the
-Database. For example, the contents of the Database could be factual
-data or works such as images, audiovisual material, text, or sounds.
-
-"Database" – A collection of material (the Contents) arranged in a
-systematic or methodical way and individually accessible by electronic
-or other means offered under the terms of this License.
-
-"Database Directive" – Means Directive 96/9/EC of the European
-Parliament and of the Council of 11 March 1996 on the legal protection
-of databases, as amended or succeeded.
-
-"Database Right" – Means rights resulting from the Chapter III ("sui
-generis") rights in the Database Directive (as amended and as transposed
-by member states), which includes the Extraction and Re-utilisation of
-the whole or a Substantial part of the Contents, as well as any similar
-rights available in the relevant jurisdiction under Section 10.4. 
-
-"Derivative Database" – Means a database based upon the Database, and
-includes any translation, adaptation, arrangement, modification, or any
-other alteration of the Database or of a Substantial part of the
-Contents. This includes, but is not limited to, Extracting or
-Re-utilising the whole or a Substantial part of the Contents in a new
-Database.
-
-"Extraction" – Means the permanent or temporary transfer of all or a
-Substantial part of the Contents to another medium by any means or in
-any form.
-
-"License" – Means this license agreement and is both a license of rights
-such as copyright and Database Rights and an agreement in contract.
-
-"Licensor" – Means the Person that offers the Database under the terms
-of this License. 
-
-"Person" – Means a natural or legal person or a body of persons
-corporate or incorporate.
-
-"Produced Work" –  a work (such as an image, audiovisual material, text,
-or sounds) resulting from using the whole or a Substantial part of the
-Contents (via a search or other query) from this Database, a Derivative
-Database, or this Database as part of a Collective Database.  
-
-"Publicly" – means to Persons other than You or under Your control by
-either more than 50% ownership or by the power to direct their
-activities (such as contracting with an independent consultant). 
-
-"Re-utilisation" – means any form of making available to the public all
-or a Substantial part of the Contents by the distribution of copies, by
-renting, by online or other forms of transmission.
-
-"Substantial" – Means substantial in terms of quantity or quality or a
-combination of both. The repeated and systematic Extraction or
-Re-utilisation of insubstantial parts of the Contents may amount to the
-Extraction or Re-utilisation of a Substantial part of the Contents.
-
-"Use" – As a verb, means doing any act that is restricted by copyright
-or Database Rights whether in the original medium or any other; and
-includes without limitation distributing, copying, publicly performing,
-publicly displaying, and preparing derivative works of the Database, as
-well as modifying the Database as may be technically necessary to use it
-in a different mode or format. 
-
-"You" – Means a Person exercising rights under this License who has not
-previously violated the terms of this License with respect to the
-Database, or who has received express permission from the Licensor to
-exercise rights under this License despite a previous violation.
-
-Words in the singular include the plural and vice versa.
-
-### 2.0 What this License covers
-
-2.1. Legal effect of this document. This License is:
-
-  a. A license of applicable copyright and neighbouring rights;
-
-  b. A license of the Database Right; and
-
-  c. An agreement in contract between You and the Licensor.
-
-2.2 Legal rights covered. This License covers the legal rights in the
-Database, including:
-
-  a. Copyright. Any copyright or neighbouring rights in the Database.
-  The copyright licensed includes any individual elements of the
-  Database, but does not cover the copyright over the Contents
-  independent of this Database. See Section 2.4 for details. Copyright
-  law varies between jurisdictions, but is likely to cover: the Database
-  model or schema, which is the structure, arrangement, and organisation
-  of the Database, and can also include the Database tables and table
-  indexes; the data entry and output sheets; and the Field names of
-  Contents stored in the Database;
-
-  b. Database Rights. Database Rights only extend to the Extraction and
-  Re-utilisation of the whole or a Substantial part of the Contents.
-  Database Rights can apply even when there is no copyright over the
-  Database. Database Rights can also apply when the Contents are removed
-  from the Database and are selected and arranged in a way that would
-  not infringe any applicable copyright; and
-
-  c. Contract. This is an agreement between You and the Licensor for
-  access to the Database. In return you agree to certain conditions of
-  use on this access as outlined in this License. 
-
-2.3 Rights not covered. 
-
-  a. This License does not apply to computer programs used in the making
-  or operation of the Database; 
-
-  b. This License does not cover any patents over the Contents or the
-  Database; and
-
-  c. This License does not cover any trademarks associated with the
-  Database. 
-
-2.4 Relationship to Contents in the Database. The individual items of
-the Contents contained in this Database may be covered by other rights,
-including copyright, patent, data protection, privacy, or personality
-rights, and this License does not cover any rights (other than Database
-Rights or in contract) in individual Contents contained in the Database.
-For example, if used on a Database of images (the Contents), this
-License would not apply to copyright over individual images, which could
-have their own separate licenses, or one single license covering all of
-the rights over the images.  
-
-### 3.0 Rights granted
-
-3.1 Subject to the terms and conditions of this License, the Licensor
-grants to You a worldwide, royalty-free, non-exclusive, terminable (but
-only under Section 9) license to Use the Database for the duration of
-any applicable copyright and Database Rights. These rights explicitly
-include commercial use, and do not exclude any field of endeavour. To
-the extent possible in the relevant jurisdiction, these rights may be
-exercised in all media and formats whether now known or created in the
-future. 
-
-The rights granted cover, for example:
-
-  a. Extraction and Re-utilisation of the whole or a Substantial part of
-  the Contents;
-
-  b. Creation of Derivative Databases;
-
-  c. Creation of Collective Databases;
-
-  d. Creation of temporary or permanent reproductions by any means and
-  in any form, in whole or in part, including of any Derivative
-  Databases or as a part of Collective Databases; and
-
-  e. Distribution, communication, display, lending, making available, or
-  performance to the public by any means and in any form, in whole or in
-  part, including of any Derivative Database or as a part of Collective
-  Databases.
-
-3.2 Compulsory license schemes. For the avoidance of doubt:
-
-  a. Non-waivable compulsory license schemes. In those jurisdictions in
-  which the right to collect royalties through any statutory or
-  compulsory licensing scheme cannot be waived, the Licensor reserves
-  the exclusive right to collect such royalties for any exercise by You
-  of the rights granted under this License;
-
-  b. Waivable compulsory license schemes. In those jurisdictions in
-  which the right to collect royalties through any statutory or
-  compulsory licensing scheme can be waived, the Licensor waives the
-  exclusive right to collect such royalties for any exercise by You of
-  the rights granted under this License; and,
-
-  c. Voluntary license schemes. The Licensor waives the right to collect
-  royalties, whether individually or, in the event that the Licensor is
-  a member of a collecting society that administers voluntary licensing
-  schemes, via that society, from any exercise by You of the rights
-  granted under this License.
-
-3.3 The right to release the Database under different terms, or to stop
-distributing or making available the Database, is reserved. Note that
-this Database may be multiple-licensed, and so You may have the choice
-of using alternative licenses for this Database. Subject to Section
-10.4, all other rights not expressly granted by Licensor are reserved.
-
-### 4.0 Conditions of Use
-
-4.1 The rights granted in Section 3 above are expressly made subject to
-Your complying with the following conditions of use. These are important
-conditions of this License, and if You fail to follow them, You will be
-in material breach of its terms.
-
-4.2 Notices. If You Publicly Convey this Database, any Derivative
-Database, or the Database as part of a Collective Database, then You
-must: 
-
-  a. Do so only under the terms of this License or another license
-  permitted under Section 4.4;
-
-  b. Include a copy of this License (or, as applicable, a license
-  permitted under Section 4.4) or its Uniform Resource Identifier (URI)
-  with the Database or Derivative Database, including both in the
-  Database or Derivative Database and in any relevant documentation; and
-
-  c. Keep intact any copyright or Database Right notices and notices
-  that refer to this License.
-
-  d. If it is not possible to put the required notices in a particular
-  file due to its structure, then You must include the notices in a
-  location (such as a relevant directory) where users would be likely to
-  look for it.
-
-4.3 Notice for using output (Contents). Creating and Using a Produced
-Work does not require the notice in Section 4.2. However, if you
-Publicly Use a Produced Work, You must include a notice associated with
-the Produced Work reasonably calculated to make any Person that uses,
-views, accesses, interacts with, or is otherwise exposed to the Produced
-Work aware that Content was obtained from the Database, Derivative
-Database, or the Database as part of a Collective Database, and that it
-is available under this License.
-
-  a. Example notice. The following text will satisfy notice under
-  Section 4.3:
-
-        Contains information from DATABASE NAME, which is made available
-        here under the Open Database License (ODbL).
-
-DATABASE NAME should be replaced with the name of the Database and a
-hyperlink to the URI of the Database. "Open Database License" should
-contain a hyperlink to the URI of the text of this License. If
-hyperlinks are not possible, You should include the plain text of the
-required URI's with the above notice.
- 
-4.4 Share alike. 
-
-  a. Any Derivative Database that You Publicly Use must be only under
-  the terms of: 
-
-    i. This License;
-
-    ii. A later version of this License similar in spirit to this
-      License; or
-
-    iii. A compatible license. 
-
-  If You license the Derivative Database under one of the licenses
-  mentioned in (iii), You must comply with the terms of that license. 
-
-  b. For the avoidance of doubt, Extraction or Re-utilisation of the
-  whole or a Substantial part of the Contents into a new database is a
-  Derivative Database and must comply with Section 4.4. 
-
-  c. Derivative Databases and Produced Works.  A Derivative Database is
-  Publicly Used and so must comply with Section 4.4. if a Produced Work
-  created from the Derivative Database is Publicly Used.
-
-  d. Share Alike and additional Contents. For the avoidance of doubt,
-  You must not add Contents to Derivative Databases under Section 4.4 a
-  that are incompatible with the rights granted under this License. 
-
-  e. Compatible licenses. Licensors may authorise a proxy to determine
-  compatible licenses under Section 4.4 a iii. If they do so, the
-  authorised proxy's public statement of acceptance of a compatible
-  license grants You permission to use the compatible license.
-
-
-4.5 Limits of Share Alike.  The requirements of Section 4.4 do not apply
-in the following:
-
-  a. For the avoidance of doubt, You are not required to license
-  Collective Databases under this License if You incorporate this
-  Database or a Derivative Database in the collection, but this License
-  still applies to this Database or a Derivative Database as a part of
-  the Collective Database; 
-
-  b. Using this Database, a Derivative Database, or this Database as
-  part of a Collective Database to create a Produced Work does not
-  create a Derivative Database for purposes of  Section 4.4; and
-
-  c. Use of a Derivative Database internally within an organisation is
-  not to the public and therefore does not fall under the requirements
-  of Section 4.4.
-
-4.6 Access to Derivative Databases. If You Publicly Use a Derivative
-Database or a Produced Work from a Derivative Database, You must also
-offer to recipients of the Derivative Database or Produced Work a copy
-in a machine readable form of:
-
-  a. The entire Derivative Database; or
-
-  b. A file containing all of the alterations made to the Database or
-  the method of making the alterations to the Database (such as an
-  algorithm), including any additional Contents, that make up all the
-  differences between the Database and the Derivative Database.
-
-The Derivative Database (under a.) or alteration file (under b.) must be
-available at no more than a reasonable production cost for physical
-distributions and free of charge if distributed over the internet.
-
-4.7 Technological measures and additional terms
-
-  a. This License does not allow You to impose (except subject to
-  Section 4.7 b.)  any terms or any technological measures on the
-  Database, a Derivative Database, or the whole or a Substantial part of
-  the Contents that alter or restrict the terms of this License, or any
-  rights granted under it, or have the effect or intent of restricting
-  the ability of any person to exercise those rights.
-
-  b. Parallel distribution. You may impose terms or technological
-  measures on the Database, a Derivative Database, or the whole or a
-  Substantial part of the Contents (a "Restricted Database") in
-  contravention of Section 4.74 a. only if You also make a copy of the
-  Database or a Derivative Database available to the recipient of the
-  Restricted Database:
-
-    i. That is available without additional fee;
-
-    ii. That is available in a medium that does not alter or restrict
-    the terms of this License, or any rights granted under it, or have
-    the effect or intent of restricting the ability of any person to
-    exercise those rights (an "Unrestricted Database"); and
-
-    iii. The Unrestricted Database is at least as accessible to the
-    recipient as a practical matter as the Restricted Database.
-
-  c. For the avoidance of doubt, You may place this Database or a
-  Derivative Database in an authenticated environment, behind a
-  password, or within a similar access control scheme provided that You
-  do not alter or restrict the terms of this License or any rights
-  granted under it or have the effect or intent of restricting the
-  ability of any person to exercise those rights. 
-
-4.8 Licensing of others. You may not sublicense the Database. Each time
-You communicate the Database, the whole or Substantial part of the
-Contents, or any Derivative Database to anyone else in any way, the
-Licensor offers to the recipient a license to the Database on the same
-terms and conditions as this License. You are not responsible for
-enforcing compliance by third parties with this License, but You may
-enforce any rights that You have over a Derivative Database. You are
-solely responsible for any modifications of a Derivative Database made
-by You or another Person at Your direction. You may not impose any
-further restrictions on the exercise of the rights granted or affirmed
-under this License.
-
-### 5.0 Moral rights
-
-5.1 Moral rights. This section covers moral rights, including any rights
-to be identified as the author of the Database or to object to treatment
-that would otherwise prejudice the author's honour and reputation, or
-any other derogatory treatment:
-
-  a. For jurisdictions allowing waiver of moral rights, Licensor waives
-  all moral rights that Licensor may have in the Database to the fullest
-  extent possible by the law of the relevant jurisdiction under Section
-  10.4; 
-
-  b. If waiver of moral rights under Section 5.1 a in the relevant
-  jurisdiction is not possible, Licensor agrees not to assert any moral
-  rights over the Database and waives all claims in moral rights to the
-  fullest extent possible by the law of the relevant jurisdiction under
-  Section 10.4; and
-
-  c. For jurisdictions not allowing waiver or an agreement not to assert
-  moral rights under Section 5.1 a and b, the author may retain their
-  moral rights over certain aspects of the Database.
-
-Please note that some jurisdictions do not allow for the waiver of moral
-rights, and so moral rights may still subsist over the Database in some
-jurisdictions.
-
-### 6.0 Fair dealing, Database exceptions, and other rights not affected 
-
-6.1 This License does not affect any rights that You or anyone else may
-independently have under any applicable law to make any use of this
-Database, including without limitation:
-
-  a. Exceptions to the Database Right including: Extraction of Contents
-  from non-electronic Databases for private purposes, Extraction for
-  purposes of illustration for teaching or scientific research, and
-  Extraction or Re-utilisation for public security or an administrative
-  or judicial procedure. 
-
-  b. Fair dealing, fair use, or any other legally recognised limitation
-  or exception to infringement of copyright or other applicable laws. 
-
-6.2 This License does not affect any rights of lawful users to Extract
-and Re-utilise insubstantial parts of the Contents, evaluated
-quantitatively or qualitatively, for any purposes whatsoever, including
-creating a Derivative Database (subject to other rights over the
-Contents, see Section 2.4). The repeated and systematic Extraction or
-Re-utilisation of insubstantial parts of the Contents may however amount
-to the Extraction or Re-utilisation of a Substantial part of the
-Contents.
-
-### 7.0 Warranties and Disclaimer
-
-7.1 The Database is licensed by the Licensor "as is" and without any
-warranty of any kind, either express, implied, or arising by statute,
-custom, course of dealing, or trade usage. Licensor specifically
-disclaims any and all implied warranties or conditions of title,
-non-infringement, accuracy or completeness, the presence or absence of
-errors, fitness for a particular purpose, merchantability, or otherwise.
-Some jurisdictions do not allow the exclusion of implied warranties, so
-this exclusion may not apply to You.
-
-### 8.0 Limitation of liability
-
-8.1 Subject to any liability that may not be excluded or limited by law,
-the Licensor is not liable for, and expressly excludes, all liability
-for loss or damage however and whenever caused to anyone by any use
-under this License, whether by You or by anyone else, and whether caused
-by any fault on the part of the Licensor or not. This exclusion of
-liability includes, but is not limited to, any special, incidental,
-consequential, punitive, or exemplary damages such as loss of revenue,
-data, anticipated profits, and lost business. This exclusion applies
-even if the Licensor has been advised of the possibility of such
-damages.
-
-8.2 If liability may not be excluded by law, it is limited to actual and
-direct financial loss to the extent it is caused by proved negligence on
-the part of the Licensor.
-
-### 9.0 Termination of Your rights under this License
-
-9.1 Any breach by You of the terms and conditions of this License
-automatically terminates this License with immediate effect and without
-notice to You. For the avoidance of doubt, Persons who have received the
-Database, the whole or a Substantial part of the Contents, Derivative
-Databases, or the Database as part of a Collective Database from You
-under this License will not have their licenses terminated provided
-their use is in full compliance with this License or a license granted
-under Section 4.8 of this License.  Sections 1, 2, 7, 8, 9 and 10 will
-survive any termination of this License.
-
-9.2 If You are not in breach of the terms of this License, the Licensor
-will not terminate Your rights under it. 
-
-9.3 Unless terminated under Section 9.1, this License is granted to You
-for the duration of applicable rights in the Database. 
-
-9.4 Reinstatement of rights. If you cease any breach of the terms and
-conditions of this License, then your full rights under this License
-will be reinstated:
-
-  a. Provisionally and subject to permanent termination until the 60th
-  day after cessation of breach; 
-
-  b. Permanently on the 60th day after cessation of breach unless
-  otherwise reasonably notified by the Licensor; or
-
-  c.  Permanently if reasonably notified by the Licensor of the
-  violation, this is the first time You have received notice of
-  violation of this License from  the Licensor, and You cure the
-  violation prior to 30 days after your receipt of the notice.
-
-Persons subject to permanent termination of rights are not eligible to
-be a recipient and receive a license under Section 4.8.
-
-9.5 Notwithstanding the above, Licensor reserves the right to release
-the Database under different license terms or to stop distributing or
-making available the Database. Releasing the Database under different
-license terms or stopping the distribution of the Database will not
-withdraw this License (or any other license that has been, or is
-required to be, granted under the terms of this License), and this
-License will continue in full force and effect unless terminated as
-stated above.
-
-### 10.0 General
-
-10.1 If any provision of this License is held to be invalid or
-unenforceable, that must not affect the validity or enforceability of
-the remainder of the terms and conditions of this License and each
-remaining provision of this License shall be valid and enforced to the
-fullest extent permitted by law. 
-
-10.2 This License is the entire agreement between the parties with
-respect to the rights granted here over the Database. It replaces any
-earlier understandings, agreements or representations with respect to
-the Database. 
-
-10.3 If You are in breach of the terms of this License, You will not be
-entitled to rely on the terms of this License or to complain of any
-breach by the Licensor. 
-
-10.4 Choice of law. This License takes effect in and will be governed by
-the laws of the relevant jurisdiction in which the License terms are
-sought to be enforced. If the standard suite of rights granted under
-applicable copyright law and Database Rights in the relevant
-jurisdiction includes additional rights not granted under this License,
-these additional rights are granted in this License in order to meet the
-terms of this License.```
-
-
-
-
 # Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)
 
 * Author: Explosion

README.md

@@ -14,61 +14,76 @@ model-index:
     metrics:
     - name: NER Precision
       type: precision
-      value: 0.8075313808
+      value: 0.8079331942
     - name: NER Recall
       type: recall
-      value: 0.8041666667
+      value: 0.80625
     - name: NER F Score
       type: f_score
-      value: 0.8058455115
+      value: 0.8070907195
+  - task:
+      name: TAG
+      type: token-classification
+    metrics:
+    - name: TAG (XPOS) Accuracy
+      type: accuracy
+      value: 0.9641646489
   - task:
       name: POS
       type: token-classification
     metrics:
-    - name: POS Accuracy
+    - name: POS (UPOS) Accuracy
       type: accuracy
-      value: 0.962905569
+      value: 0.9641646489
   - task:
-      name: SENTER
+      name: MORPH
       type: token-classification
     metrics:
-    - name: SENTER Precision
-      type: precision
-      value: 0.908438061
-    - name: SENTER Recall
-      type: recall
-      value: 0.8971631206
-    - name: SENTER F Score
-      type: f_score
-      value: 0.902765388
+    - name: Morph (UFeats) Accuracy
+      type: accuracy
+      value: 0.9505084746
   - task:
-      name: UNLABELED_DEPENDENCIES
+      name: LEMMA
       type: token-classification
     metrics:
-    - name: Unlabeled Dependencies Accuracy
+    - name: Lemma Accuracy
       type: accuracy
-      value: 0.8220632614
+      value: 0.9481840194
+  - task:
+      name: UNLABELED_DEPENDENCIES
+      type: token-classification
+    metrics:
+    - name: Unlabeled Attachment Score (UAS)
+      type: f_score
+      value: 0.8130063132
   - task:
       name: LABELED_DEPENDENCIES
       type: token-classification
     metrics:
-    - name: Labeled Dependencies Accuracy
-      type: accuracy
-      value: 0.8220632614
+    - name: Labeled Attachment Score (LAS)
+      type: f_score
+      value: 0.7723336499
+  - task:
+      name: SENTS
+      type: token-classification
+    metrics:
+    - name: Sentences F-Score
+      type: f_score
+      value: 0.9112107623
 ---
 ### Details: https://spacy.io/models/da#da_core_news_md
 
-Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler, lemmatizer.
+Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, lemmatizer (trainable_lemmatizer), senter, ner, attribute_ruler.
 
 | Feature | Description |
 | --- | --- |
 | **Name** | `da_core_news_md` |
-| **Version** | `3.2.0` |
-| **spaCy** | `>=3.2.0,<3.3.0` |
-| **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` |
-| **Components** | `tok2vec`, `morphologizer`, `parser`, `senter`, `attribute_ruler`, `lemmatizer`, `ner` |
+| **Version** | `3.3.0` |
+| **spaCy** | `>=3.3.0.dev0,<3.4.0` |
+| **Default Pipeline** | `tok2vec`, `morphologizer`, `parser`, `lemmatizer`, `attribute_ruler`, `ner` |
+| **Components** | `tok2vec`, `morphologizer`, `parser`, `lemmatizer`, `senter`, `attribute_ruler`, `ner` |
 | **Vectors** | 500000 keys, 20000 unique vectors (300 dimensions) |
-| **Sources** | [UD Danish DDT v2.8](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[Lemmatization Lists](https://github.com/michmech/lemmatization-lists/) (Michal Měchura)<br />[Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)](https://spacy.io) (Explosion) |
+| **Sources** | [UD Danish DDT v2.8](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)](https://spacy.io) (Explosion) |
 | **License** | `CC BY-SA 4.0` |
 | **Author** | [Explosion](https://explosion.ai) |
 
@@ -76,13 +91,12 @@ Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, s
 
 <details>
 
-<summary>View label scheme (195 labels for 4 components)</summary>
+<summary>View label scheme (193 labels for 3 components)</summary>
 
 | Component | Labels |
 | --- | --- |
 | **`morphologizer`** | `AdpType=Prep\|POS=ADP`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=AUX\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=PROPN`, `Definite=Ind\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=ADV`, `Number=Plur\|POS=DET\|PronType=Dem`, `Degree=Pos\|Number=Plur\|POS=ADJ`, `Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=PUNCT`, `POS=CCONJ`, `Definite=Ind\|Degree=Cmp\|Number=Sing\|POS=ADJ`, `Degree=Cmp\|POS=ADJ`, `POS=PRON\|PartType=Inf`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Definite=Ind\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Neut\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Dem`, `Degree=Pos\|POS=ADV`, `Definite=Def\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=PRON\|PronType=Dem`, `NumType=Card\|POS=NUM`, `Definite=Ind\|Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `NumType=Ord\|POS=ADJ`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Mood=Ind\|POS=AUX\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=VERB\|VerbForm=Inf\|Voice=Act`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Pass`, `POS=ADP\|PartType=Inf`, `Degree=Pos\|POS=ADJ`, `Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `POS=AUX\|VerbForm=Inf\|Voice=Act`, `Definite=Ind\|Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Number=Plur\|POS=DET\|PronType=Ind`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Ind`, `Case=Acc\|POS=PRON\|Person=3\|PronType=Prs\|Reflex=Yes`, `POS=PART\|PartType=Inf`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Acc\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Nom\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Nom\|Gender=Com\|POS=PRON\|PronType=Ind`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Ind`, `Mood=Imp\|POS=VERB`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|Number=Sing\|POS=AUX\|Tense=Past\|VerbForm=Part`, `POS=X`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=VERB\|Tense=Pres\|VerbForm=Part`, `Number=Plur\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|VerbForm=Inf\|Voice=Pass`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Degree=Cmp\|POS=ADV`, `POS=ADV\|PartType=Inf`, `Degree=Sup\|POS=ADV`, `Number=Plur\|POS=PRON\|PronType=Dem`, `Number=Plur\|POS=PRON\|PronType=Ind`, `Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|POS=PROPN`, `POS=ADP`, `Degree=Cmp\|Number=Plur\|POS=ADJ`, `Definite=Def\|Degree=Sup\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Gender=Com\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Number=Plur\|POS=PRON\|PronType=Rcp`, `Case=Gen\|Degree=Cmp\|POS=ADJ`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=INTJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Number=Plur\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Definite=Def\|Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Sing\|POS=NOUN`, `Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `POS=SYM`, `Case=Nom\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Degree=Sup\|POS=ADJ`, `Number=Plur\|POS=DET\|PronType=Ind\|Style=Arch`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Foreign=Yes\|POS=X`, `POS=DET\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Dem`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Gen\|POS=PRON\|PronType=Int,Rel`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Dem`, `Abbr=Yes\|POS=X`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Abs\|POS=ADJ`, `Definite=Ind\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Definite=Ind\|POS=NOUN`, `Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Degree=Abs\|POS=ADV`, `POS=VERB\|VerbForm=Ger`, `POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Plur\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Gen\|Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Gen\|Degree=Pos\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|Tense=Pres`, `Case=Gen\|Number=Plur\|POS=DET\|PronType=Ind`, `Number[psor]=Plur\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=PRON\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=AUX\|Tense=Pres\|VerbForm=Part`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Pass`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Plur\|POS=NOUN`, `Case=Gen\|Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Mood=Imp\|POS=AUX`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs`, `Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Gen\|POS=NOUN`, `Number[psor]=Plur\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=DET\|PronType=Dem`, `Definite=Def\|Number=Plur\|POS=NOUN` |
 | **`parser`** | `ROOT`, `acl:relcl`, `advcl`, `advmod`, `advmod:lmod`, `amod`, `appos`, `aux`, `case`, `cc`, `ccomp`, `compound:prt`, `conj`, `cop`, `dep`, `det`, `expl`, `fixed`, `flat`, `iobj`, `list`, `mark`, `nmod`, `nmod:poss`, `nsubj`, `nummod`, `obj`, `obl`, `obl:lmod`, `obl:tmod`, `punct`, `xcomp` |
-| **`senter`** | `I`, `S` |
 | **`ner`** | `LOC`, `MISC`, `ORG`, `PER` |
 
 </details>
@@ -95,18 +109,18 @@ Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, s
 | `TOKEN_P` | 99.78 |
 | `TOKEN_R` | 99.75 |
 | `TOKEN_F` | 99.76 |
-| `POS_ACC` | 96.29 |
-| `MORPH_ACC` | 94.88 |
-| `MORPH_MICRO_P` | 96.65 |
-| `MORPH_MICRO_R` | 96.11 |
-| `MORPH_MICRO_F` | 96.38 |
-| `SENTS_P` | 90.84 |
-| `SENTS_R` | 89.72 |
-| `SENTS_F` | 90.28 |
-| `DEP_UAS` | 82.21 |
-| `DEP_LAS` | 78.13 |
-| `TAG_ACC` | 96.29 |
-| `LEMMA_ACC` | 84.91 |
-| `ENTS_P` | 80.75 |
-| `ENTS_R` | 80.42 |
-| `ENTS_F` | 80.58 |
+| `POS_ACC` | 96.42 |
+| `MORPH_ACC` | 95.05 |
+| `MORPH_MICRO_P` | 96.69 |
+| `MORPH_MICRO_R` | 96.16 |
+| `MORPH_MICRO_F` | 96.42 |
+| `SENTS_P` | 92.20 |
+| `SENTS_R` | 90.07 |
+| `SENTS_F` | 91.12 |
+| `DEP_UAS` | 81.30 |
+| `DEP_LAS` | 77.23 |
+| `LEMMA_ACC` | 94.82 |
+| `TAG_ACC` | 96.42 |
+| `ENTS_P` | 80.79 |
+| `ENTS_R` | 80.62 |
+| `ENTS_F` | 80.71 |

accuracy.json

@@ -3,51 +3,51 @@
   "token_p": 0.9977732598,
   "token_r": 0.9974835463,
   "token_f": 0.997628382,
-  "pos_acc": 0.962905569,
-  "morph_acc": 0.9487651332,
-  "morph_micro_p": 0.9664501066,
-  "morph_micro_r": 0.9611327041,
-  "morph_micro_f": 0.9637840711,
+  "pos_acc": 0.9641646489,
+  "morph_acc": 0.9505084746,
+  "morph_micro_p": 0.9668578389,
+  "morph_micro_r": 0.9615869971,
+  "morph_micro_f": 0.9642152149,
   "morph_per_feat": {
     "Mood": {
-      "p": 0.9789674952,
-      "r": 0.9761677788,
-      "f": 0.9775656325
+      "p": 0.9723809524,
+      "r": 0.9733079123,
+      "f": 0.9728442115
     },
     "Tense": {
-      "p": 0.9698340875,
+      "p": 0.9669172932,
       "r": 0.968373494,
-      "f": 0.9691032404
+      "f": 0.9676448457
     },
     "VerbForm": {
-      "p": 0.9631449631,
-      "r": 0.9596083231,
-      "f": 0.9613733906
+      "p": 0.9583588487,
+      "r": 0.9577723378,
+      "f": 0.9580655035
     },
     "Voice": {
-      "p": 0.9782934132,
+      "p": 0.9739195231,
       "r": 0.9768310912,
-      "f": 0.9775617053
+      "f": 0.9753731343
     },
     "Definite": {
-      "p": 0.9633027523,
-      "r": 0.9541683129,
-      "f": 0.9587137753
+      "p": 0.964940239,
+      "r": 0.9569340182,
+      "f": 0.9609204523
     },
     "Gender": {
-      "p": 0.9459098497,
+      "p": 0.9487608841,
       "r": 0.9415088069,
-      "f": 0.9437041972
+      "f": 0.9451209341
     },
     "Number": {
-      "p": 0.9618621778,
-      "r": 0.9538341158,
-      "f": 0.9578313253
+      "p": 0.9608615708,
+      "r": 0.95409494,
+      "f": 0.9574663002
     },
     "AdpType": {
-      "p": 0.9973333333,
+      "p": 1.0,
       "r": 0.9920424403,
-      "f": 0.9946808511
+      "f": 0.9960053262
     },
     "PartType": {
       "p": 1.0,
@@ -55,29 +55,29 @@
       "f": 1.0
     },
     "Case": {
-      "p": 0.9696485623,
-      "r": 0.9589257504,
-      "f": 0.9642573471
+      "p": 0.9775641026,
+      "r": 0.9636650869,
+      "f": 0.9705648369
     },
     "Person": {
-      "p": 0.9704347826,
-      "r": 0.9911190053,
-      "f": 0.9806678383
+      "p": 0.9788359788,
+      "r": 0.9857904085,
+      "f": 0.982300885
     },
     "PronType": {
-      "p": 0.9811165846,
+      "p": 0.9851607585,
       "r": 0.9827302632,
-      "f": 0.9819227609
+      "f": 0.9839440099
     },
     "NumType": {
-      "p": 0.9794520548,
-      "r": 0.9470198675,
-      "f": 0.962962963
+      "p": 0.9863013699,
+      "r": 0.9536423841,
+      "f": 0.9696969697
     },
     "Degree": {
-      "p": 0.9520295203,
-      "r": 0.9325301205,
-      "f": 0.942178941
+      "p": 0.9548229548,
+      "r": 0.9421686747,
+      "f": 0.9484536082
     },
     "Reflex": {
       "p": 1.0,
@@ -85,14 +85,14 @@
       "f": 1.0
     },
     "Number[psor]": {
-      "p": 0.9662921348,
-      "r": 1.0,
-      "f": 0.9828571429
+      "p": 0.988372093,
+      "r": 0.988372093,
+      "f": 0.988372093
     },
     "Poss": {
-      "p": 0.9777777778,
-      "r": 1.0,
-      "f": 0.9887640449
+      "p": 0.9886363636,
+      "r": 0.9886363636,
+      "f": 0.9886363636
     },
     "Foreign": {
       "p": 0.6666666667,
@@ -115,141 +115,146 @@
       "f": 0.8571428571
     }
   },
-  "sents_p": 0.908438061,
-  "sents_r": 0.8971631206,
-  "sents_f": 0.902765388,
-  "dep_uas": 0.8220632614,
-  "dep_las": 0.7813355686,
+  "sents_p": 0.9219600726,
+  "sents_r": 0.9007092199,
+  "sents_f": 0.9112107623,
+  "dep_uas": 0.8130063132,
+  "dep_las": 0.7723336499,
   "dep_las_per_type": {
     "advmod": {
-      "p": 0.7073509015,
-      "r": 0.7203389831,
-      "f": 0.7137858642
+      "p": 0.6868965517,
+      "r": 0.7033898305,
+      "f": 0.6950453594
     },
     "root": {
-      "p": 0.8411552347,
-      "r": 0.8262411348,
-      "f": 0.8336314848
+      "p": 0.8381818182,
+      "r": 0.8173758865,
+      "f": 0.8276481149
     },
     "nsubj": {
-      "p": 0.8428417653,
-      "r": 0.8259493671,
-      "f": 0.8343100693
+      "p": 0.8317460317,
+      "r": 0.8291139241,
+      "f": 0.8304278922
     },
     "case": {
-      "p": 0.881372549,
-      "r": 0.8865877712,
-      "f": 0.883972468
+      "p": 0.883218842,
+      "r": 0.8875739645,
+      "f": 0.8853910477
     },
     "obl": {
-      "p": 0.7053291536,
-      "r": 0.698757764,
-      "f": 0.7020280811
+      "p": 0.6935483871,
+      "r": 0.6677018634,
+      "f": 0.6803797468
     },
     "cc": {
-      "p": 0.7851002865,
-      "r": 0.7965116279,
-      "f": 0.7907647908
+      "p": 0.7797101449,
+      "r": 0.7819767442,
+      "f": 0.7808417997
     },
     "conj": {
-      "p": 0.6491712707,
-      "r": 0.6266666667,
-      "f": 0.6377204885
+      "p": 0.6305555556,
+      "r": 0.6053333333,
+      "f": 0.6176870748
     },
     "obj": {
-      "p": 0.8033088235,
-      "r": 0.8485436893,
-      "f": 0.8253068933
+      "p": 0.7667269439,
+      "r": 0.8233009709,
+      "f": 0.7940074906
     },
     "aux": {
-      "p": 0.875739645,
-      "r": 0.8629737609,
-      "f": 0.8693098385
+      "p": 0.8797653959,
+      "r": 0.8746355685,
+      "f": 0.8771929825
     },
     "acl:relcl": {
-      "p": 0.5879120879,
+      "p": 0.6011235955,
       "r": 0.5783783784,
-      "f": 0.583106267
+      "f": 0.5895316804
     },
     "advmod:lmod": {
-      "p": 0.7586206897,
-      "r": 0.6567164179,
-      "f": 0.704
+      "p": 0.6388888889,
+      "r": 0.6865671642,
+      "f": 0.6618705036
     },
     "det": {
-      "p": 0.9194078947,
-      "r": 0.92092257,
-      "f": 0.9201646091
+      "p": 0.9143327842,
+      "r": 0.9143327842,
+      "f": 0.9143327842
     },
     "amod": {
-      "p": 0.8193979933,
-      "r": 0.8361774744,
-      "f": 0.8277027027
+      "p": 0.7954173486,
+      "r": 0.8293515358,
+      "f": 0.8120300752
     },
     "nmod:poss": {
-      "p": 0.7340425532,
-      "r": 0.6831683168,
-      "f": 0.7076923077
+      "p": 0.6593406593,
+      "r": 0.5940594059,
+      "f": 0.625
     },
     "ccomp": {
-      "p": 0.5652173913,
-      "r": 0.6290322581,
-      "f": 0.5954198473
+      "p": 0.5890410959,
+      "r": 0.6935483871,
+      "f": 0.637037037
     },
     "nummod": {
-      "p": 0.8306451613,
+      "p": 0.8512396694,
       "r": 0.8583333333,
-      "f": 0.8442622951
+      "f": 0.8547717842
     },
     "flat": {
-      "p": 0.7636363636,
-      "r": 0.8344370861,
-      "f": 0.7974683544
+      "p": 0.7514450867,
+      "r": 0.8609271523,
+      "f": 0.8024691358
     },
     "compound:prt": {
-      "p": 0.5,
-      "r": 0.3170731707,
-      "f": 0.3880597015
+      "p": 0.4285714286,
+      "r": 0.2195121951,
+      "f": 0.2903225806
     },
     "advcl": {
-      "p": 0.6339285714,
-      "r": 0.6120689655,
-      "f": 0.6228070175
+      "p": 0.5909090909,
+      "r": 0.5603448276,
+      "f": 0.5752212389
     },
     "mark": {
-      "p": 0.8905579399,
-      "r": 0.8521560575,
-      "f": 0.870933893
+      "p": 0.8742138365,
+      "r": 0.8562628337,
+      "f": 0.8651452282
     },
     "cop": {
-      "p": 0.7837837838,
-      "r": 0.8285714286,
-      "f": 0.8055555556
+      "p": 0.7891891892,
+      "r": 0.8342857143,
+      "f": 0.8111111111
     },
     "dep": {
-      "p": 0.1555555556,
+      "p": 0.1538461538,
       "r": 0.2641509434,
-      "f": 0.1958041958
+      "f": 0.1944444444
     },
     "nmod": {
-      "p": 0.6352941176,
-      "r": 0.6328125,
-      "f": 0.6340508806
+      "p": 0.6551724138,
+      "r": 0.630859375,
+      "f": 0.6427860697
     },
     "iobj": {
-      "p": 0.8125,
-      "r": 0.5909090909,
-      "f": 0.6842105263
+      "p": 0.7272727273,
+      "r": 0.3636363636,
+      "f": 0.4848484848
     },
     "xcomp": {
-      "p": 0.5675675676,
+      "p": 0.5833333333,
       "r": 0.3559322034,
-      "f": 0.4375
+      "f": 0.4421052632
+    },
+    "appos": {
+      "p": 0.4375,
+      "r": 0.4242424242,
+      "f": 0.4307692308
     },
     "list": {
-      "p": 0.4,
-      "r": 0.2222222222,
-      "f": 0.2857142857
+      "p": 0.375,
+      "r": 0.1666666667,
+      "f": 0.2307692308
     },
     "vocative": {
       "p": 0.0,
@@ -262,57 +267,52 @@
       "f": 0.8461538462
     },
     "expl": {
-      "p": 0.8484848485,
-      "r": 0.8235294118,
-      "f": 0.8358208955
-    },
-    "appos": {
-      "p": 0.4146341463,
-      "r": 0.5151515152,
-      "f": 0.4594594595
+      "p": 0.8181818182,
+      "r": 0.7941176471,
+      "f": 0.8059701493
     },
     "obl:tmod": {
-      "p": 0.6,
-      "r": 0.3333333333,
-      "f": 0.4285714286
+      "p": 0.7777777778,
+      "r": 0.3888888889,
+      "f": 0.5185185185
     },
-    "discourse": {
+    "obl:lmod": {
       "p": 0.0,
       "r": 0.0,
       "f": 0.0
     },
-    "obl:lmod": {
+    "discourse": {
       "p": 0.0,
       "r": 0.0,
       "f": 0.0
     }
   },
-  "tag_acc": 0.962905569,
-  "lemma_acc": 0.8491041162,
-  "ents_p": 0.8075313808,
-  "ents_r": 0.8041666667,
-  "ents_f": 0.8058455115,
+  "lemma_acc": 0.9481840194,
+  "tag_acc": 0.9641646489,
+  "ents_p": 0.8079331942,
+  "ents_r": 0.80625,
+  "ents_f": 0.8070907195,
   "ents_per_type": {
     "PER": {
-      "p": 0.9215686275,
+      "p": 0.88125,
       "r": 0.8493975904,
-      "f": 0.8840125392
+      "f": 0.8650306748
     },
     "ORG": {
-      "p": 0.7032967033,
-      "r": 0.7111111111,
-      "f": 0.7071823204
+      "p": 0.7294117647,
+      "r": 0.6888888889,
+      "f": 0.7085714286
     },
     "MISC": {
-      "p": 0.7179487179,
-      "r": 0.7433628319,
-      "f": 0.7304347826
+      "p": 0.6991869919,
+      "r": 0.7610619469,
+      "f": 0.7288135593
     },
     "LOC": {
-      "p": 0.8290598291,
-      "r": 0.8738738739,
-      "f": 0.850877193
+      "p": 0.8828828829,
+      "r": 0.8828828829,
+      "f": 0.8828828829
     }
   },
-  "speed": 10055.5372609128
+  "speed": 11453.5916881723
 }

config.cfg

@@ -10,7 +10,7 @@ seed = 0
 
 [nlp]
 lang = "da"
-pipeline = ["tok2vec","morphologizer","parser","senter","attribute_ruler","lemmatizer","ner"]
+pipeline = ["tok2vec","morphologizer","parser","lemmatizer","senter","attribute_ruler","ner"]
 disabled = ["senter"]
 before_creation = null
 after_creation = null
@@ -26,11 +26,22 @@ scorer = {"@scorers":"spacy.attribute_ruler_scorer.v1"}
 validate = false
 
 [components.lemmatizer]
-factory = "lemmatizer"
-mode = "lookup"
-model = null
+factory = "trainable_lemmatizer"
+backoff = "orth"
+min_tree_freq = 3
 overwrite = false
 scorer = {"@scorers":"spacy.lemmatizer_scorer.v1"}
+top_k = 1
+
+[components.lemmatizer.model]
+@architectures = "spacy.Tagger.v2"
+nO = null
+normalize = false
+
+[components.lemmatizer.model.tok2vec]
+@architectures = "spacy.Tok2VecListener.v1"
+width = ${components.tok2vec.model.encode:width}
+upstream = "tok2vec"
 
 [components.morphologizer]
 factory = "morphologizer"
@@ -39,8 +50,9 @@ overwrite = true
 scorer = {"@scorers":"spacy.morphologizer_scorer.v1"}
 
 [components.morphologizer.model]
-@architectures = "spacy.Tagger.v1"
+@architectures = "spacy.Tagger.v2"
 nO = null
+normalize = false
 
 [components.morphologizer.model.tok2vec]
 @architectures = "spacy.Tok2VecListener.v1"
@@ -70,7 +82,7 @@ nO = null
 @architectures = "spacy.MultiHashEmbed.v2"
 width = 96
 attrs = ["NORM","PREFIX","SUFFIX","SHAPE","SPACY"]
-rows = [5000,2500,2500,2500,100]
+rows = [5000,1000,2500,2500,50]
 include_static_vectors = true
 
 [components.ner.model.tok2vec.encode]
@@ -108,8 +120,9 @@ overwrite = false
 scorer = {"@scorers":"spacy.senter_scorer.v1"}
 
 [components.senter.model]
-@architectures = "spacy.Tagger.v1"
+@architectures = "spacy.Tagger.v2"
 nO = null
+normalize = false
 
 [components.senter.model.tok2vec]
 @architectures = "spacy.Tok2Vec.v2"
@@ -138,7 +151,7 @@ factory = "tok2vec"
 @architectures = "spacy.MultiHashEmbed.v2"
 width = ${components.tok2vec.model.encode:width}
 attrs = ["NORM","PREFIX","SUFFIX","SHAPE","SPACY"]
-rows = [5000,2500,2500,2500,100]
+rows = [5000,1000,2500,2500,50]
 include_static_vectors = true
 
 [components.tok2vec.model.encode]
@@ -175,7 +188,7 @@ dropout = 0.1
 accumulate_gradient = 1
 patience = 5000
 max_epochs = 0
-max_steps = 0
+max_steps = 100000
 eval_frequency = 1000
 frozen_components = []
 before_to_disk = null
@@ -210,17 +223,17 @@ eps = 0.00000001
 learn_rate = 0.001
 
 [training.score_weights]
-pos_acc = 0.08
-morph_acc = 0.08
+pos_acc = 0.14
+morph_acc = 0.14
 morph_per_feat = null
 dep_uas = 0.0
-dep_las = 0.16
+dep_las = 0.29
 dep_las_per_type = null
 sents_p = null
 sents_r = null
-sents_f = 0.02
-lemma_acc = 0.5
-ents_f = 0.16
+sents_f = 0.04
+lemma_acc = 0.1
+ents_f = 0.29
 ents_p = 0.0
 ents_r = 0.0
 ents_per_type = null
@@ -237,6 +250,13 @@ after_init = null
 
 [initialize.components]
 
+[initialize.components.lemmatizer]
+
+[initialize.components.lemmatizer.labels]
+@readers = "spacy.read_labels.v1"
+path = "corpus/labels/trainable_lemmatizer.json"
+require = false
+
 [initialize.components.morphologizer]
 
 [initialize.components.morphologizer.labels]

da_core_news_md-any-py3-none-any.whl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0195b5af78d68d4f3a6895cfa3cde98871682bbddc4b04c375770980fac4d222
-size 48943545
+oid sha256:25dcaba4499ac19b4f1d23884cc5896401eb1e2c896c6a49c10a6f8fe6190398
+size 42193668

lemmatizer/cfg

@@ -0,0 +1,457 @@
+{
+  "labels":[
+    1,
+    2,
+    4,
+    6,
+    8,
+    10,
+    12,
+    14,
+    16,
+    18,
+    20,
+    24,
+    28,
+    30,
+    32,
+    34,
+    36,
+    39,
+    41,
+    42,
+    43,
+    45,
+    47,
+    49,
+    51,
+    53,
+    55,
+    57,
+    61,
+    65,
+    67,
+    71,
+    73,
+    75,
+    77,
+    79,
+    81,
+    83,
+    85,
+    87,
+    89,
+    91,
+    93,
+    95,
+    99,
+    101,
+    102,
+    104,
+    107,
+    111,
+    113,
+    116,
+    118,
+    121,
+    124,
+    127,
+    128,
+    131,
+    133,
+    134,
+    136,
+    138,
+    140,
+    142,
+    144,
+    145,
+    147,
+    148,
+    149,
+    153,
+    155,
+    158,
+    161,
+    164,
+    166,
+    168,
+    170,
+    172,
+    174,
+    175,
+    177,
+    179,
+    182,
+    184,
+    186,
+    188,
+    190,
+    192,
+    194,
+    196,
+    199,
+    201,
+    203,
+    204,
+    207,
+    208,
+    209,
+    211,
+    213,
+    214,
+    216,
+    218,
+    220,
+    222,
+    224,
+    226,
+    229,
+    231,
+    232,
+    233,
+    235,
+    236,
+    238,
+    239,
+    243,
+    249,
+    253,
+    255,
+    257,
+    259,
+    261,
+    262,
+    263,
+    264,
+    267,
+    269,
+    270,
+    272,
+    274,
+    276,
+    278,
+    280,
+    282,
+    284,
+    286,
+    290,
+    291,
+    293,
+    295,
+    297,
+    299,
+    300,
+    302,
+    303,
+    304,
+    306,
+    308,
+    311,
+    314,
+    315,
+    317,
+    320,
+    321,
+    323,
+    324,
+    326,
+    327,
+    328,
+    330,
+    331,
+    333,
+    337,
+    339,
+    340,
+    344,
+    346,
+    350,
+    353,
+    354,
+    355,
+    358,
+    360,
+    361,
+    363,
+    365,
+    366,
+    369,
+    372,
+    373,
+    376,
+    380,
+    382,
+    383,
+    384,
+    386,
+    387,
+    389,
+    391,
+    392,
+    394,
+    395,
+    398,
+    400,
+    402,
+    404,
+    406,
+    409,
+    411,
+    412,
+    413,
+    415,
+    417,
+    420,
+    421,
+    423,
+    424,
+    425,
+    427,
+    429,
+    431,
+    433,
+    434,
+    436,
+    437,
+    439,
+    440,
+    442,
+    444,
+    445,
+    449,
+    450,
+    452,
+    454,
+    457,
+    459,
+    462,
+    465,
+    466,
+    468,
+    470,
+    471,
+    474,
+    475,
+    478,
+    480,
+    483,
+    485,
+    486,
+    487,
+    489,
+    491,
+    492,
+    493,
+    495,
+    496,
+    498,
+    500,
+    501,
+    502,
+    503,
+    504,
+    505,
+    507,
+    508,
+    509,
+    510,
+    511,
+    512,
+    514,
+    515,
+    516,
+    518,
+    519,
+    520,
+    521,
+    523,
+    525,
+    526,
+    528,
+    531,
+    533,
+    535,
+    453,
+    536,
+    538,
+    539,
+    541,
+    545,
+    547,
+    548,
+    549,
+    550,
+    551,
+    553,
+    554,
+    555,
+    557,
+    559,
+    560,
+    561,
+    563,
+    565,
+    566,
+    567,
+    568,
+    570,
+    571,
+    575,
+    577,
+    578,
+    579,
+    582,
+    585,
+    587,
+    589,
+    593,
+    594,
+    596,
+    597,
+    601,
+    603,
+    605,
+    609,
+    611,
+    612,
+    613,
+    614,
+    615,
+    616,
+    617,
+    619,
+    621,
+    622,
+    624,
+    625,
+    627,
+    628,
+    629,
+    632,
+    634,
+    638,
+    639,
+    640,
+    642,
+    644,
+    647,
+    649,
+    650,
+    651,
+    653,
+    654,
+    655,
+    657,
+    658,
+    659,
+    661,
+    663,
+    665,
+    667,
+    669,
+    670,
+    672,
+    674,
+    676,
+    677,
+    678,
+    680,
+    682,
+    683,
+    685,
+    686,
+    688,
+    689,
+    690,
+    691,
+    694,
+    695,
+    696,
+    697,
+    699,
+    700,
+    701,
+    703,
+    705,
+    706,
+    707,
+    708,
+    712,
+    715,
+    716,
+    718,
+    720,
+    724,
+    726,
+    729,
+    730,
+    732,
+    733,
+    734,
+    736,
+    738,
+    739,
+    740,
+    741,
+    742,
+    743,
+    744,
+    747,
+    749,
+    753,
+    756,
+    758,
+    759,
+    761,
+    762,
+    763,
+    764,
+    766,
+    768,
+    769,
+    771,
+    773,
+    774,
+    775,
+    776,
+    777,
+    781,
+    783,
+    784,
+    785,
+    788,
+    791,
+    792,
+    794,
+    796,
+    797,
+    798,
+    799,
+    800,
+    802,
+    803,
+    804,
+    805,
+    806,
+    808,
+    809,
+    810,
+    811,
+    812,
+    814,
+    815,
+    817,
+    819,
+    820,
+    822,
+    824,
+    825,
+    827,
+    829,
+    831,
+    833,
+    835,
+    837
+  ]
+}

lemmatizer/{lookups/lookups.bin → model}

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6864ce8705293ba1b6dcf349ec133cdc33db3ba57f6e9337458cfe5073b6f103
-size 11537995
+oid sha256:5dbaeda1129c701ac9da038242ad1d176d2d9b00e1b9fdaaefa9fd25435920f3
+size 176206

meta.json

@@ -1,14 +1,14 @@
 {
   "lang":"da",
   "name":"core_news_md",
-  "version":"3.2.0",
-  "description":"Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler, lemmatizer.",
+  "version":"3.3.0",
+  "description":"Danish pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, lemmatizer (trainable_lemmatizer), senter, ner, attribute_ruler.",
   "author":"Explosion",
   "email":"contact@explosion.ai",
   "url":"https://explosion.ai",
   "license":"CC BY-SA 4.0",
-  "spacy_version":">=3.2.0,<3.3.0",
-  "spacy_git_version":"bb26550e2",
+  "spacy_version":">=3.3.0.dev0,<3.4.0",
+  "spacy_git_version":"849bef2de",
   "vectors":{
     "width":300,
     "vectors":20000,
@@ -212,15 +212,8 @@
       "punct",
       "xcomp"
     ],
-    "senter":[
-      "I",
-      "S"
-    ],
     "attribute_ruler":[
 
-    ],
-    "lemmatizer":[
-
     ],
     "ner":[
       "LOC",
@@ -233,17 +226,17 @@
     "tok2vec",
     "morphologizer",
     "parser",
-    "attribute_ruler",
     "lemmatizer",
+    "attribute_ruler",
     "ner"
   ],
   "components":[
     "tok2vec",
     "morphologizer",
     "parser",
+    "lemmatizer",
     "senter",
     "attribute_ruler",
-    "lemmatizer",
     "ner"
   ],
   "disabled":[
@@ -254,51 +247,51 @@
     "token_p":0.9977732598,
     "token_r":0.9974835463,
     "token_f":0.997628382,
-    "pos_acc":0.962905569,
-    "morph_acc":0.9487651332,
-    "morph_micro_p":0.9664501066,
-    "morph_micro_r":0.9611327041,
-    "morph_micro_f":0.9637840711,
+    "pos_acc":0.9641646489,
+    "morph_acc":0.9505084746,
+    "morph_micro_p":0.9668578389,
+    "morph_micro_r":0.9615869971,
+    "morph_micro_f":0.9642152149,
     "morph_per_feat":{
       "Mood":{
-        "p":0.9789674952,
-        "r":0.9761677788,
-        "f":0.9775656325
+        "p":0.9723809524,
+        "r":0.9733079123,
+        "f":0.9728442115
       },
       "Tense":{
-        "p":0.9698340875,
+        "p":0.9669172932,
         "r":0.968373494,
-        "f":0.9691032404
+        "f":0.9676448457
       },
       "VerbForm":{
-        "p":0.9631449631,
-        "r":0.9596083231,
-        "f":0.9613733906
+        "p":0.9583588487,
+        "r":0.9577723378,
+        "f":0.9580655035
       },
       "Voice":{
-        "p":0.9782934132,
+        "p":0.9739195231,
         "r":0.9768310912,
-        "f":0.9775617053
+        "f":0.9753731343
       },
       "Definite":{
-        "p":0.9633027523,
-        "r":0.9541683129,
-        "f":0.9587137753
+        "p":0.964940239,
+        "r":0.9569340182,
+        "f":0.9609204523
       },
       "Gender":{
-        "p":0.9459098497,
+        "p":0.9487608841,
         "r":0.9415088069,
-        "f":0.9437041972
+        "f":0.9451209341
       },
       "Number":{
-        "p":0.9618621778,
-        "r":0.9538341158,
-        "f":0.9578313253
+        "p":0.9608615708,
+        "r":0.95409494,
+        "f":0.9574663002
       },
       "AdpType":{
-        "p":0.9973333333,
+        "p":1.0,
         "r":0.9920424403,
-        "f":0.9946808511
+        "f":0.9960053262
       },
       "PartType":{
         "p":1.0,
@@ -306,29 +299,29 @@
         "f":1.0
       },
       "Case":{
-        "p":0.9696485623,
-        "r":0.9589257504,
-        "f":0.9642573471
+        "p":0.9775641026,
+        "r":0.9636650869,
+        "f":0.9705648369
       },
       "Person":{
-        "p":0.9704347826,
-        "r":0.9911190053,
-        "f":0.9806678383
+        "p":0.9788359788,
+        "r":0.9857904085,
+        "f":0.982300885
       },
       "PronType":{
-        "p":0.9811165846,
+        "p":0.9851607585,
         "r":0.9827302632,
-        "f":0.9819227609
+        "f":0.9839440099
       },
       "NumType":{
-        "p":0.9794520548,
-        "r":0.9470198675,
-        "f":0.962962963
+        "p":0.9863013699,
+        "r":0.9536423841,
+        "f":0.9696969697
       },
       "Degree":{
-        "p":0.9520295203,
-        "r":0.9325301205,
-        "f":0.942178941
+        "p":0.9548229548,
+        "r":0.9421686747,
+        "f":0.9484536082
       },
       "Reflex":{
         "p":1.0,
@@ -336,14 +329,14 @@
         "f":1.0
       },
       "Number[psor]":{
-        "p":0.9662921348,
-        "r":1.0,
-        "f":0.9828571429
+        "p":0.988372093,
+        "r":0.988372093,
+        "f":0.988372093
       },
       "Poss":{
-        "p":0.9777777778,
-        "r":1.0,
-        "f":0.9887640449
+        "p":0.9886363636,
+        "r":0.9886363636,
+        "f":0.9886363636
       },
       "Foreign":{
         "p":0.6666666667,
@@ -366,141 +359,146 @@
         "f":0.8571428571
       }
     },
-    "sents_p":0.908438061,
-    "sents_r":0.8971631206,
-    "sents_f":0.902765388,
-    "dep_uas":0.8220632614,
-    "dep_las":0.7813355686,
+    "sents_p":0.9219600726,
+    "sents_r":0.9007092199,
+    "sents_f":0.9112107623,
+    "dep_uas":0.8130063132,
+    "dep_las":0.7723336499,
     "dep_las_per_type":{
       "advmod":{
-        "p":0.7073509015,
-        "r":0.7203389831,
-        "f":0.7137858642
+        "p":0.6868965517,
+        "r":0.7033898305,
+        "f":0.6950453594
       },
       "root":{
-        "p":0.8411552347,
-        "r":0.8262411348,
-        "f":0.8336314848
+        "p":0.8381818182,
+        "r":0.8173758865,
+        "f":0.8276481149
       },
       "nsubj":{
-        "p":0.8428417653,
-        "r":0.8259493671,
-        "f":0.8343100693
+        "p":0.8317460317,
+        "r":0.8291139241,
+        "f":0.8304278922
       },
       "case":{
-        "p":0.881372549,
-        "r":0.8865877712,
-        "f":0.883972468
+        "p":0.883218842,
+        "r":0.8875739645,
+        "f":0.8853910477
       },
       "obl":{
-        "p":0.7053291536,
-        "r":0.698757764,
-        "f":0.7020280811
+        "p":0.6935483871,
+        "r":0.6677018634,
+        "f":0.6803797468
       },
       "cc":{
-        "p":0.7851002865,
-        "r":0.7965116279,
-        "f":0.7907647908
+        "p":0.7797101449,
+        "r":0.7819767442,
+        "f":0.7808417997
       },
       "conj":{
-        "p":0.6491712707,
-        "r":0.6266666667,
-        "f":0.6377204885
+        "p":0.6305555556,
+        "r":0.6053333333,
+        "f":0.6176870748
       },
       "obj":{
-        "p":0.8033088235,
-        "r":0.8485436893,
-        "f":0.8253068933
+        "p":0.7667269439,
+        "r":0.8233009709,
+        "f":0.7940074906
       },
       "aux":{
-        "p":0.875739645,
-        "r":0.8629737609,
-        "f":0.8693098385
+        "p":0.8797653959,
+        "r":0.8746355685,
+        "f":0.8771929825
       },
       "acl:relcl":{
-        "p":0.5879120879,
+        "p":0.6011235955,
         "r":0.5783783784,
-        "f":0.583106267
+        "f":0.5895316804
       },
       "advmod:lmod":{
-        "p":0.7586206897,
-        "r":0.6567164179,
-        "f":0.704
+        "p":0.6388888889,
+        "r":0.6865671642,
+        "f":0.6618705036
       },
       "det":{
-        "p":0.9194078947,
-        "r":0.92092257,
-        "f":0.9201646091
+        "p":0.9143327842,
+        "r":0.9143327842,
+        "f":0.9143327842
       },
       "amod":{
-        "p":0.8193979933,
-        "r":0.8361774744,
-        "f":0.8277027027
+        "p":0.7954173486,
+        "r":0.8293515358,
+        "f":0.8120300752
       },
       "nmod:poss":{
-        "p":0.7340425532,
-        "r":0.6831683168,
-        "f":0.7076923077
+        "p":0.6593406593,
+        "r":0.5940594059,
+        "f":0.625
       },
       "ccomp":{
-        "p":0.5652173913,
-        "r":0.6290322581,
-        "f":0.5954198473
+        "p":0.5890410959,
+        "r":0.6935483871,
+        "f":0.637037037
       },
       "nummod":{
-        "p":0.8306451613,
+        "p":0.8512396694,
         "r":0.8583333333,
-        "f":0.8442622951
+        "f":0.8547717842
       },
       "flat":{
-        "p":0.7636363636,
-        "r":0.8344370861,
-        "f":0.7974683544
+        "p":0.7514450867,
+        "r":0.8609271523,
+        "f":0.8024691358
       },
       "compound:prt":{
-        "p":0.5,
-        "r":0.3170731707,
-        "f":0.3880597015
+        "p":0.4285714286,
+        "r":0.2195121951,
+        "f":0.2903225806
       },
       "advcl":{
-        "p":0.6339285714,
-        "r":0.6120689655,
-        "f":0.6228070175
+        "p":0.5909090909,
+        "r":0.5603448276,
+        "f":0.5752212389
       },
       "mark":{
-        "p":0.8905579399,
-        "r":0.8521560575,
-        "f":0.870933893
+        "p":0.8742138365,
+        "r":0.8562628337,
+        "f":0.8651452282
       },
       "cop":{
-        "p":0.7837837838,
-        "r":0.8285714286,
-        "f":0.8055555556
+        "p":0.7891891892,
+        "r":0.8342857143,
+        "f":0.8111111111
       },
       "dep":{
-        "p":0.1555555556,
+        "p":0.1538461538,
         "r":0.2641509434,
-        "f":0.1958041958
+        "f":0.1944444444
       },
       "nmod":{
-        "p":0.6352941176,
-        "r":0.6328125,
-        "f":0.6340508806
+        "p":0.6551724138,
+        "r":0.630859375,
+        "f":0.6427860697
       },
       "iobj":{
-        "p":0.8125,
-        "r":0.5909090909,
-        "f":0.6842105263
+        "p":0.7272727273,
+        "r":0.3636363636,
+        "f":0.4848484848
       },
       "xcomp":{
-        "p":0.5675675676,
+        "p":0.5833333333,
         "r":0.3559322034,
-        "f":0.4375
+        "f":0.4421052632
+      },
+      "appos":{
+        "p":0.4375,
+        "r":0.4242424242,
+        "f":0.4307692308
       },
       "list":{
-        "p":0.4,
-        "r":0.2222222222,
-        "f":0.2857142857
+        "p":0.375,
+        "r":0.1666666667,
+        "f":0.2307692308
       },
       "vocative":{
         "p":0.0,
@@ -513,59 +511,54 @@
         "f":0.8461538462
       },
       "expl":{
-        "p":0.8484848485,
-        "r":0.8235294118,
-        "f":0.8358208955
-      },
-      "appos":{
-        "p":0.4146341463,
-        "r":0.5151515152,
-        "f":0.4594594595
+        "p":0.8181818182,
+        "r":0.7941176471,
+        "f":0.8059701493
       },
       "obl:tmod":{
-        "p":0.6,
-        "r":0.3333333333,
-        "f":0.4285714286
+        "p":0.7777777778,
+        "r":0.3888888889,
+        "f":0.5185185185
       },
-      "discourse":{
+      "obl:lmod":{
         "p":0.0,
         "r":0.0,
         "f":0.0
       },
-      "obl:lmod":{
+      "discourse":{
         "p":0.0,
         "r":0.0,
         "f":0.0
       }
     },
-    "tag_acc":0.962905569,
-    "lemma_acc":0.8491041162,
-    "ents_p":0.8075313808,
-    "ents_r":0.8041666667,
-    "ents_f":0.8058455115,
+    "lemma_acc":0.9481840194,
+    "tag_acc":0.9641646489,
+    "ents_p":0.8079331942,
+    "ents_r":0.80625,
+    "ents_f":0.8070907195,
     "ents_per_type":{
       "PER":{
-        "p":0.9215686275,
+        "p":0.88125,
         "r":0.8493975904,
-        "f":0.8840125392
+        "f":0.8650306748
       },
       "ORG":{
-        "p":0.7032967033,
-        "r":0.7111111111,
-        "f":0.7071823204
+        "p":0.7294117647,
+        "r":0.6888888889,
+        "f":0.7085714286
       },
       "MISC":{
-        "p":0.7179487179,
-        "r":0.7433628319,
-        "f":0.7304347826
+        "p":0.6991869919,
+        "r":0.7610619469,
+        "f":0.7288135593
       },
       "LOC":{
-        "p":0.8290598291,
-        "r":0.8738738739,
-        "f":0.850877193
+        "p":0.8828828829,
+        "r":0.8828828829,
+        "f":0.8828828829
       }
     },
-    "speed":10055.5372609128
+    "speed":11453.5916881723
   },
   "sources":[
     {
@@ -580,12 +573,6 @@
       "license":"CC BY-SA 4.0",
       "author":"Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders S\u00f8gaard"
     },
-    {
-      "name":"Lemmatization Lists",
-      "url":"https://github.com/michmech/lemmatization-lists/",
-      "license":"ODbL",
-      "author":"Michal M\u011bchura"
-    },
     {
       "name":"Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)",
       "url":"https://spacy.io",

morphologizer/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ead2b660084c7bfc2a612bb768ab44d12531106592aa980e916b605ab811d3c3
-size 61299
+oid sha256:20e85c840781c0f123abc619c03c85399ed4a8bb47ae7fa1535c3b6d4d75276b
+size 61351

ner/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ce8c46254cc538ef54b60e106195afc64fad4c7c7235f3343405fc54a77286a
-size 7091792
+oid sha256:444f9832c0b6efee7c93e41b2bd5ef98a098d6f0a71e36a62f7677a042909eda
+size 6496592

parser/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3c0868e96825dd96c1135f853ccfc4ae3fe02a104277ceb94d2ffde4c79b17a2
+oid sha256:aae04c7eef9ac270ea79e71070b4d694069e21888c8adc6747f24c97da6c915d
 size 308728

parser/moves

@@ -1 +1 @@
-��moves�D{"0":{"":41514},"1":{"":34295},"2":{"case":7489,"nsubj":6009,"det":4334,"amod":3968,"advmod":3657,"mark":3529,"aux":2432,"cc":2261,"punct":2182,"cop":1329,"obl":894,"nummod":799,"nmod:poss":651,"nmod":460,"expl":291,"ccomp":202,"obj":195,"xcomp":122,"case||nmod":73,"obl:tmod":53,"dep":49,"acl:relcl":43},"3":{"punct":8601,"obl":3949,"obj":3758,"nmod":3565,"conj":2745,"advmod":2095,"flat":1295,"nsubj":1172,"acl:relcl":1131,"advcl":808,"amod":628,"advmod:lmod":423,"fixed":390,"dep":322,"xcomp":272,"appos":268,"compound:prt":261,"ccomp":252,"acl:relcl||nsubj":237,"case":202,"nummod":167,"list":161,"nmod:poss":156,"punct||conj":151,"mark":137,"cc":135,"iobj":107,"expl":77,"cop":69,"nmod||case":60,"aux":48,"obl:tmod":45,"obl:lmod":44,"cc||case":43,"advcl||advmod":43,"cc||conj":40,"case||obl":38,"punct||case":33},"4":{"ROOT":4367}}�cfg��neg_key�
+��moves�D{"0":{"":41615},"1":{"":34382},"2":{"case":7526,"nsubj":6005,"det":4341,"amod":3967,"advmod":3662,"mark":3530,"aux":2436,"cc":2264,"punct":2187,"cop":1330,"obl":894,"nummod":834,"nmod:poss":656,"nmod":463,"expl":291,"ccomp":203,"obj":195,"xcomp":122,"case||nmod":73,"obl:tmod":53,"dep":48,"acl:relcl":43},"3":{"punct":8693,"obl":3951,"obj":3760,"nmod":3569,"conj":2747,"advmod":2087,"flat":1302,"nsubj":1169,"acl:relcl":1132,"advcl":809,"amod":622,"advmod:lmod":423,"fixed":390,"dep":322,"xcomp":272,"appos":268,"compound:prt":261,"ccomp":252,"acl:relcl||nsubj":237,"case":202,"nummod":168,"list":159,"nmod:poss":156,"punct||conj":151,"cc":135,"mark":133,"iobj":107,"expl":77,"cop":69,"nmod||case":60,"aux":48,"obl:tmod":45,"obl:lmod":44,"cc||case":43,"advcl||advmod":43,"cc||conj":40,"case||obl":38,"punct||case":33},"4":{"ROOT":4383}}�cfg��neg_key�

senter/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ea62d9f10a446fc6fa69a24f6a681d5e348eba73629e4109096d76fdc9a8303e
-size 219901
+oid sha256:4c17e994908cc6549918a2f0af54d58ec0988bc312bd7c574607b97218e51b9b
+size 219953

tok2vec/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0c43e62abccb37657f2afce3e900c32f1b97d0878127ae1c32fcbeffec90ba5d
-size 6960804
+oid sha256:624296ccca73db9a8aa6cf2abbfb11dd88155ffa8c0bd55a79243c0ef4627a04
+size 6365604

vocab/strings.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:42fe610567bec6fa69da580a4753d083f1f4429efd32b3c1fa638b6a07a6757e
-size 10070327
+oid sha256:e742e4f89864a4c4e0324e2c5f25f320183d5db9dd09d3e8fa9e7260bc26ab56
+size 10080884