roberta-crf-boundary-news-ner

RoBERTa + CRF news NER model, extended from [Souvikbasur/roberta-crf-news-ner]({"https://huggingface.co/" + CHECKPOINT_REPO}) with:

  • A boundary-guided interaction module (auxiliary start/end token classifiers gating the shared representation before the CRF classifier), inspired by Zheng et al. (2019, EMNLP-IJCNLP) and Gao et al. (2022).
  • Boundary-smoothed multi-task loss (Zhu & Li, 2022, ACL) combining the CRF negative log-likelihood with the boundary auxiliary loss.
  • FGM adversarial training on the token embeddings (Miyato et al., 2017).
  • An optional confidence-based boundary-correction post-processing step at inference.

This is a fine-tuning extension of an existing checkpoint, evaluated with an ablation against the base CRF model โ€” see the linked paper/repo for the actual measured numbers. Do not assume improvement without checking the evaluation cells in the training notebook.

Trained on the same 17-category custom news NER dataset and train/val/test split as Souvikbasur/roberta-crf-news-ner.

Requires the custom RobertaCRFBoundaryForNER class (see the training notebook) to load โ€” a bare state_dict isn't loadable via AutoModel.from_pretrained alone.

Downloads last month
11
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support