ModernBERT-TR PII Recognition

A 150M-parameter Turkish token classifier with 25 KVKK-oriented entity types and 51 BIO labels.

Results

Our model scores 80.85 +/- 0.19% overlap micro-F2 on a 300-document test set. The released checkpoint scores 81.01%.

The quantized int8 version scores 71.90% overlap micro-F2.

Usage

from transformers import pipeline

detect = pipeline(
    "token-classification",
    model="ytu-ce-cosmos/modernbert-tr-pii-ner",
    aggregation_strategy="first",
)
detect("Ayşe Yılmaz'a ayse@example.com adresinden ulaşabilirsiniz.")

You can call the tokenizer with is_split_into_words=True to allow the tokenizer to split the sentence into words, and keep the first WordPiece label for each word.

Training

We finetune ytu-ce-cosmos/modernbert-tr-base on an 8,014-document mixture of Turkish web PDFs, anonymized high-court decisions, born-labeled synthetic documents, and OCR-degraded synthetic documents; the loader retained 7,763 training documents. Real-document labels came from up to a three-model panel. We use learning rate 2e-5, batch size 16, three epochs, cosine decay, 10% warmup, weight decay 0.01, normalized inverse-frequency weights raised to 0.3, and three seeds.

Standalone binaries are available in the encoderfile repo.