nb_core_news_md / README.md

Update spaCy pipeline

570279b about 3 years ago

13 kB

	---
	tags:
	- spacy
	- token-classification
	language:
	- nb
	license: MIT
	model-index:
	- name: nb_core_news_md
	results:
	- task:
	name: NER
	type: token-classification
	metrics:
	- name: NER Precision
	type: precision
	value: 0.8454221165
	- name: NER Recall
	type: recall
	value: 0.8399291199
	- name: NER F Score
	type: f_score
	value: 0.8426666667
	- task:
	name: POS
	type: token-classification
	metrics:
	- name: POS Accuracy
	type: accuracy
	value: 0.9713020031
	- task:
	name: SENTER
	type: token-classification
	metrics:
	- name: SENTER Precision
	type: precision
	value: 0.9275123558
	- name: SENTER Recall
	type: recall
	value: 0.9328914664
	- name: SENTER F Score
	type: f_score
	value: 0.9301941347
	- task:
	name: UNLABELED_DEPENDENCIES
	type: token-classification
	metrics:
	- name: Unlabeled Dependencies Accuracy
	type: accuracy
	value: 0.8928487837
	- task:
	name: LABELED_DEPENDENCIES
	type: token-classification
	metrics:
	- name: Labeled Dependencies Accuracy
	type: accuracy
	value: 0.8928487837
	---
	### Details: https://spacy.io/models/nb#nb_core_news_md

	Norwegian (Bokmål) pipeline optimized for CPU. Components: tok2vec, morphologizer, parser, senter, ner, attribute_ruler, lemmatizer.

	\| Feature \| Description \|
	\| --- \| --- \|
	\| Name \| `nb_core_news_md` \|
	\| Version \| `3.1.0` \|
	\| spaCy \| `>=3.1.0,<3.2.0` \|
	\| Default Pipeline \| `tok2vec`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` \|
	\| Components \| `tok2vec`, `morphologizer`, `parser`, `senter`, `attribute_ruler`, `lemmatizer`, `ner` \|
	\| Vectors \| 500000 keys, 20000 unique vectors (300 dimensions) \|
	\| Sources \| [UD Norwegian Bokmaal (from NorNE)](https://github.com/UniversalDependencies/UD_Norwegian-Bokmaal) (Øvrelid, Lilja; Jørgensen, Fredrik; Hohle, Petter)<br />[NorNE: Norwegian Named Entities (commit: 5e4059dc)](https://github.com/ltgoslo/norne) (Language Technology Group (University of Oslo))<br />[Norsk Ordbank in Norwegian Bokmål](https://www.nb.no/sprakbanken/show?serial=oai%3Anb.no%3Asbr-5&lang=en) (CLARINO NB - Språkbanken, Nasjonalbiblioteket, Norway)<br />[Explosion fastText Vectors (cbow, OSCAR Common Crawl + Wikipedia)](https://spacy.io) (Explosion) \|
	\| License \| `MIT` \|
	\| Author \| [Explosion](https://explosion.ai) \|

	### Label Scheme

	<details>

	<summary>View label scheme (245 labels for 4 components)</summary>

	\| Component \| Labels \|
	\| --- \| --- \|
	\| `morphologizer` \| `Definite=Ind\\|Gender=Neut\\|Number=Sing\\|POS=NOUN`, `POS=CCONJ`, `Definite=Ind\\|Gender=Masc\\|Number=Sing\\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\\|Gender=Masc\\|Number=Sing\\|POS=NOUN`, `Definite=Ind\\|Gender=Neut\\|Number=Plur\\|POS=NOUN`, `POS=PUNCT`, `Mood=Ind\\|POS=VERB\\|Tense=Past\\|VerbForm=Fin`, `POS=ADP`, `Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Definite=Def\\|Degree=Pos\\|Number=Sing\\|POS=ADJ`, `POS=PROPN`, `POS=X`, `Mood=Ind\\|POS=VERB\\|Tense=Pres\\|VerbForm=Fin`, `Definite=Def\\|Gender=Neut\\|Number=Sing\\|POS=NOUN`, `POS=PRON\\|PronType=Rel`, `Mood=Ind\\|POS=AUX\\|Tense=Pres\\|VerbForm=Fin`, `Definite=Ind\\|Gender=Neut\\|Number=Sing\\|POS=ADJ\\|VerbForm=Part`, `Definite=Ind\\|Degree=Pos\\|Number=Sing\\|POS=ADJ`, `Definite=Ind\\|Gender=Fem\\|Number=Sing\\|POS=NOUN`, `Number=Plur\\|POS=ADJ\\|VerbForm=Part`, `Definite=Ind\\|Gender=Fem\\|Number=Plur\\|POS=NOUN`, `POS=ADV`, `Gender=Neut\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Definite=Ind\\|Number=Sing\\|POS=ADJ\\|VerbForm=Part`, `POS=VERB\\|VerbForm=Part`, `Definite=Ind\\|Gender=Masc\\|Number=Plur\\|POS=NOUN`, `Definite=Ind\\|Degree=Pos\\|Gender=Neut\\|Number=Sing\\|POS=ADJ`, `Degree=Pos\\|Number=Plur\\|POS=ADJ`, `NumType=Card\\|Number=Plur\\|POS=NUM`, `Definite=Def\\|Gender=Masc\\|Number=Plur\\|POS=NOUN`, `Case=Acc\\|POS=PRON\\|PronType=Prs\\|Reflex=Yes`, `Case=Gen\\|Definite=Ind\\|Gender=Neut\\|Number=Sing\\|POS=NOUN`, `POS=PART`, `POS=VERB\\|VerbForm=Inf`, `Case=Nom\\|Number=Plur\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Mood=Ind\\|POS=AUX\\|Tense=Past\\|VerbForm=Fin`, `Gender=Fem\\|POS=PROPN`, `POS=NOUN`, `Gender=Masc\\|POS=PROPN`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Art`, `Case=Gen\\|Definite=Def\\|Gender=Masc\\|Number=Sing\\|POS=NOUN`, `Abbr=Yes\\|POS=PROPN`, `POS=PART\\|Polarity=Neg`, `Number=Plur\\|POS=PRON\\|Poss=Yes\\|PronType=Prs`, `Case=Gen\\|Definite=Ind\\|Gender=Neut\\|Number=Plur\\|POS=NOUN`, `Case=Gen\\|POS=PROPN`, `Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Gender=Masc\\|Number=Sing\\|POS=PRON\\|Poss=Yes\\|PronType=Prs`, `Definite=Def\\|Degree=Sup\\|POS=ADJ`, `Case=Gen\\|Gender=Fem\\|POS=PROPN`, `Number=Plur\\|POS=DET\\|PronType=Dem`, `Case=Gen\\|Definite=Def\\|Gender=Neut\\|Number=Sing\\|POS=NOUN`, `Definite=Ind\\|Degree=Sup\\|POS=ADJ`, `Definite=Def\\|Gender=Fem\\|Number=Plur\\|POS=NOUN`, `Gender=Neut\\|POS=PROPN`, `Number=Plur\\|POS=DET\\|PronType=Int`, `Definite=Def\\|Gender=Neut\\|Number=Plur\\|POS=NOUN`, `Definite=Def\\|POS=DET\\|PronType=Dem`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Art`, `Mood=Ind\\|POS=VERB\\|Tense=Pres\\|VerbForm=Fin\\|Voice=Pass`, `Abbr=Yes\\|Case=Gen\\|POS=PROPN`, `Animacy=Hum\\|Case=Nom\\|Gender=Masc\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Degree=Cmp\\|POS=ADJ`, `POS=ADJ\\|VerbForm=Part`, `Gender=Neut\\|Number=Sing\\|POS=PRON\\|Poss=Yes\\|PronType=Prs`, `Abbr=Yes\\|POS=ADP`, `Definite=Ind\\|Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Prs`, `Case=Gen\\|Definite=Def\\|Gender=Neut\\|Number=Plur\\|POS=NOUN`, `POS=AUX\\|VerbForm=Part`, `POS=PRON\\|PronType=Int`, `Gender=Fem\\|Number=Sing\\|POS=PRON\\|Poss=Yes\\|PronType=Prs`, `Number=Plur\\|POS=PRON\\|Person=3\\|PronType=Ind,Prs`, `Number=Plur\\|POS=DET\\|PronType=Ind`, `Degree=Pos\\|POS=ADJ`, `Animacy=Hum\\|Case=Nom\\|Number=Plur\\|POS=PRON\\|Person=1\\|PronType=Prs`, `POS=VERB\\|VerbForm=Inf\\|Voice=Pass`, `Definite=Ind\\|Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Ind`, `Animacy=Hum\\|Case=Acc\\|Gender=Masc\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Animacy=Hum\\|Case=Nom\\|Number=Sing\\|POS=PRON\\|Person=1\\|PronType=Prs`, `Number=Plur\\|POS=DET\\|Polarity=Neg\\|PronType=Neg`, `NumType=Card\\|POS=NUM`, `Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Ind`, `POS=DET\\|PronType=Prs`, `Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Ind`, `Case=Gen\\|Gender=Neut\\|POS=PROPN`, `Gender=Masc\\|Number=Sing\\|POS=DET\\|Polarity=Neg\\|PronType=Neg`, `Definite=Def\\|Number=Sing\\|POS=ADJ\\|VerbForm=Part`, `Gender=Fem,Masc\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs`, `POS=AUX\\|VerbForm=Inf`, `Case=Acc\\|Number=Plur\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Case=Gen\\|Degree=Pos\\|Number=Plur\\|POS=ADJ`, `Number=Plur\\|POS=DET\\|PronType=Tot`, `Case=Gen\\|Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Number=Plur\\|POS=DET\\|PronType=Prs`, `POS=SYM`, `Gender=Neut\\|NumType=Card\\|Number=Sing\\|POS=NUM`, `Animacy=Hum\\|Case=Nom\\|Number=Sing\\|POS=PRON\\|PronType=Prs`, `Definite=Ind\\|Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Prs`, `Case=Gen\\|Definite=Ind\\|Gender=Masc\\|Number=Sing\\|POS=NOUN`, `Abbr=Yes\\|POS=ADV`, `Definite=Ind\\|Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Tot`, `Definite=Def\\|POS=DET\\|PronType=Prs`, `Animacy=Hum\\|Case=Nom\\|Gender=Fem\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Gender=Neut\\|POS=NOUN`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Int`, `Definite=Def\\|NumType=Card\\|POS=NUM`, `Mood=Imp\\|POS=VERB\\|VerbForm=Fin`, `Definite=Ind\\|Number=Plur\\|POS=NOUN`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Tot`, `Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Tot`, `Animacy=Hum\\|Case=Acc\\|Number=Plur\\|POS=PRON\\|Person=1\\|PronType=Prs`, `Gender=Fem,Masc\\|Number=Sing\\|POS=PRON\\|Person=3\\|Polarity=Neg\\|PronType=Neg,Prs`, `Number=Plur\\|POS=PRON\\|Person=3\\|Polarity=Neg\\|PronType=Neg,Prs`, `Definite=Def\\|NumType=Card\\|Number=Sing\\|POS=NUM`, `Gender=Masc\\|NumType=Card\\|Number=Sing\\|POS=NUM`, `Definite=Ind\\|Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Case=Gen\\|Definite=Def\\|Gender=Fem\\|Number=Plur\\|POS=NOUN`, `Case=Gen\\|Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Animacy=Hum\\|Number=Sing\\|POS=PRON\\|PronType=Art,Prs`, `Mood=Imp\\|POS=AUX\\|VerbForm=Fin`, `Number=Plur\\|POS=PRON\\|Person=3\\|PronType=Prs,Tot`, `Number=Plur\\|POS=ADJ`, `Gender=Masc\\|POS=NOUN`, `Abbr=Yes\\|POS=NOUN`, `Case=Gen\\|Definite=Ind\\|Gender=Masc\\|Number=Plur\\|POS=NOUN`, `Gender=Neut\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Ind,Prs`, `POS=INTJ`, `Animacy=Hum\\|Case=Nom\\|Number=Sing\\|POS=PRON\\|Person=2\\|PronType=Prs`, `Animacy=Hum\\|Case=Acc\\|Number=Sing\\|POS=PRON\\|Person=1\\|PronType=Prs`, `Case=Gen\\|Definite=Def\\|Gender=Masc\\|Number=Plur\\|POS=NOUN`, `POS=ADJ`, `Animacy=Hum\\|Case=Acc\\|Gender=Fem\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Animacy=Hum\\|Case=Acc\\|Number=Sing\\|POS=PRON\\|Person=2\\|PronType=Prs`, `Definite=Def\\|Gender=Fem\\|Number=Sing\\|POS=NOUN`, `Number=Sing\\|POS=PRON\\|Polarity=Neg\\|PronType=Neg`, `Case=Gen\\|POS=NOUN`, `Definite=Ind\\|Number=Sing\\|POS=ADJ`, `Case=Gen\\|Gender=Masc\\|POS=PROPN`, `Animacy=Hum\\|Number=Plur\\|POS=PRON\\|PronType=Rcp`, `Case=Gen\\|Definite=Ind\\|Gender=Fem\\|Number=Sing\\|POS=NOUN`, `Number=Plur\\|POS=PRON\\|Person=3\\|PronType=Prs`, `Gender=Fem,Masc\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Ind,Prs`, `Definite=Ind\\|Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Prs`, `Case=Gen\\|Definite=Def\\|Gender=Fem\\|Number=Sing\\|POS=NOUN`, `Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Art`, `Case=Gen\\|Definite=Def\\|Degree=Pos\\|Number=Sing\\|POS=ADJ`, `Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Int`, `NumType=Card\\|Number=Sing\\|POS=NUM`, `Animacy=Hum\\|Case=Acc\\|Number=Plur\\|POS=PRON\\|Person=2\\|PronType=Prs`, `Animacy=Hum\\|Case=Nom\\|Number=Plur\\|POS=PRON\\|Person=2\\|PronType=Prs`, `Case=Gen\\|Definite=Ind\\|Degree=Pos\\|Gender=Neut\\|Number=Sing\\|POS=ADJ`, `Degree=Sup\\|POS=ADJ`, `Animacy=Hum\\|POS=PRON\\|PronType=Int`, `POS=DET\\|PronType=Ind`, `Definite=Def\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Gender=Fem\\|POS=NOUN`, `Case=Gen\\|Number=Plur\\|POS=DET\\|PronType=Dem`, `Gender=Fem,Masc\\|Number=Sing\\|POS=PRON\\|Person=3\\|PronType=Prs,Tot`, `Case=Gen\\|Definite=Ind\\|Gender=Fem\\|Number=Plur\\|POS=NOUN`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|Polarity=Neg\\|PronType=Neg`, `Number=Plur\\|POS=NOUN`, `Case=Gen\\|Definite=Ind\\|Degree=Pos\\|Number=Sing\\|POS=ADJ`, `Definite=Ind\\|Number=Sing\\|POS=VERB\\|VerbForm=Part`, `Case=Gen\\|Definite=Def\\|Number=Sing\\|POS=ADJ\\|VerbForm=Part`, `Mood=Ind\\|POS=VERB\\|Tense=Past\\|VerbForm=Fin\\|Voice=Pass`, `Gender=Neut\\|Number=Sing\\|POS=DET\\|PronType=Dem,Ind`, `Animacy=Hum\\|POS=PRON\\|Poss=Yes\\|PronType=Int`, `Abbr=Yes\\|POS=ADJ`, `Case=Gen\\|Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Art`, `Abbr=Yes\\|Definite=Def,Ind\\|Gender=Masc\\|Number=Sing\\|POS=NOUN`, `POS=PRON\\|PronType=Prs`, `Case=Gen\\|Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Number=Plur\\|POS=PRON\\|Poss=Yes\\|PronType=Rcp`, `Definite=Ind\\|Degree=Pos\\|POS=ADJ`, `Number=Plur\\|POS=DET\\|PronType=Art`, `Case=Gen\\|NumType=Card\\|Number=Plur\\|POS=NUM`, `Abbr=Yes\\|Definite=Def,Ind\\|Gender=Neut\\|Number=Plur,Sing\\|POS=NOUN`, `Case=Gen\\|Number=Plur\\|POS=DET\\|PronType=Tot`, `Abbr=Yes\\|Definite=Def,Ind\\|Gender=Masc\\|Number=Plur,Sing\\|POS=NOUN`, `Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Int`, `Definite=Ind\\|Gender=Neut\\|Number=Sing\\|POS=ADJ`, `Case=Gen\\|Definite=Ind\\|Gender=Masc\\|Number=Sing\\|POS=DET\\|PronType=Dem`, `Gender=Fem\\|Number=Sing\\|POS=DET\\|PronType=Prs`, `Animacy=Hum\\|Case=Gen,Nom\\|Number=Sing\\|POS=PRON\\|PronType=Art,Prs`, `Definite=Def\\|Degree=Pos\\|Gender=Masc\\|Number=Sing\\|POS=ADJ`, `Animacy=Hum\\|Case=Gen\\|Number=Sing\\|POS=PRON\\|PronType=Art,Prs`, `Gender=Fem\\|NumType=Card\\|Number=Sing\\|POS=NUM`, `Definite=Ind\\|Gender=Masc\\|POS=NOUN`, `Definite=Def\\|Number=Plur\\|POS=NOUN`, `Number=Sing\\|POS=ADJ\\|VerbForm=Part`, `Definite=Ind\\|Gender=Masc\\|Number=Sing\\|POS=ADJ\\|VerbForm=Part`, `Abbr=Yes\\|Gender=Masc\\|POS=NOUN`, `Abbr=Yes\\|Case=Gen\\|POS=NOUN`, `Abbr=Yes\\|Mood=Ind\\|POS=VERB\\|Tense=Pres\\|VerbForm=Fin`, `Abbr=Yes\\|Degree=Pos\\|POS=ADJ`, `Case=Gen\\|Gender=Fem\\|POS=NOUN`, `Case=Gen\\|Degree=Cmp\\|POS=ADJ`, `Definite=Ind\\|Degree=Pos\\|Gender=Masc\\|Number=Sing\\|POS=ADJ`, `Gender=Masc\\|Number=Sing\\|POS=NOUN` \|
	\| `parser` \| `ROOT`, `acl`, `acl:cleft`, `acl:relcl`, `advcl`, `advmod`, `amod`, `appos`, `aux`, `aux:pass`, `case`, `cc`, `ccomp`, `compound`, `compound:prt`, `conj`, `cop`, `csubj`, `dep`, `det`, `discourse`, `expl`, `flat:foreign`, `flat:name`, `iobj`, `mark`, `nmod`, `nsubj`, `nsubj:pass`, `nummod`, `obj`, `obl`, `orphan`, `parataxis`, `punct`, `xcomp` \|
	\| `senter` \| `I`, `S` \|
	\| `ner` \| `LOC`, `MISC`, `ORG`, `PER` \|

	</details>

	### Accuracy

	\| Type \| Score \|
	\| --- \| --- \|
	\| `TOKEN_ACC` \| 99.90 \|
	\| `TAG_ACC` \| 97.13 \|
	\| `POS_ACC` \| 97.25 \|
	\| `MORPH_ACC` \| 95.85 \|
	\| `LEMMA_ACC` \| 76.71 \|
	\| `DEP_UAS` \| 89.28 \|
	\| `DEP_LAS` \| 86.30 \|
	\| `ENTS_P` \| 84.54 \|
	\| `ENTS_R` \| 83.99 \|
	\| `ENTS_F` \| 84.27 \|
	\| `SENTS_P` \| 92.75 \|
	\| `SENTS_R` \| 93.29 \|
	\| `SENTS_F` \| 93.02 \|