Phazel/fa_ent_news_lg

Persian named entity recognizer optimized for CPU, with its own internal tok2vec. Labels: PER, LOC, ORG, DAT, MON, TIM, PCT.

Feature	Description
Name	fa_ent_news_lg
Version	3.8.0
spaCy	>=3.8.14,<3.9.0
Default Pipeline	ner
Components	ner
Vectors	-1 keys, 200000 unique vectors (300 dimensions)
Sources	UD_Persian-PerDT NER layer (not-to-release/Dadegan with NER tag/) (PerDT authors, tagged with Beheshti-NER (Taher, Hoseini, Shamsfard 2020)) spaCy lang/fa language data (stop words originally from HAZM) (Explosion and spaCy contributors) fa_floret static vectors (lg tier: 200k rows x 300d floret table trained on the full Persian Wikipedia dump, 5 epochs, via spacy-vectors-builder) (Kiyarash Fazeli)
License	CC BY-SA 4.0
Author	Kiyarash Fazeli

Label Scheme

View label scheme (7 labels for 1 components)

Component	Labels
ner	DAT, LOC, MON, ORG, PCT, PER, TIM

Accuracy

Type	Score
ENTS_P	81.51
ENTS_R	71.09
ENTS_F	75.94

Trained on UD_Persian-PerDT, licensed CC BY-SA 4.0; this pipeline is therefore distributed under CC BY-SA 4.0 with attribution to the treebank authors. The ner component is trained on the NER layer shipped in UD_Persian-PerDT's not-to-release/ directory, so it shares the treebank's genre, tokenization and licence. Those labels are SILVER: the treebank README states they were produced by the BERT-based Beheshti-NER tagger (Taher et al., 2020) with manual corrections to extend recall. They were transferred onto this pipeline's tokenization by difflib alignment at a 99.86% transfer rate (scripts/transfer_perdt_ner.py); spans that could not be aligned exactly were dropped rather than guessed. Labels PER, LOC, ORG and DAT have 1,300 or more training examples each; MON (205), TIM (135) and PCT (121) are thin and their scores in performance.ents_per_type should be read before relying on them. This is the lg tier: identical architecture to sm/md but a larger static floret vector table (200,000 rows x 300 dimensions, minn=maxn=5, hash_count=2) trained on the full Persian Wikipedia dump for 5 epochs via spacy-vectors-builder. Same zero-OOV rationale as md (see docs/MODELS.md): floret hashes subwords into a fixed table, so token.has_vector is always True despite Persian's ZWNJ (U+200C) inconsistency.