Arabic Named Entity Recognition
This project is made to enrich the Arabic Named Entity Recognition(ANER). Arabic is a tough language to deal with and has alot of difficulties. We managed to made a model based on Arabert to support 50 entities.
Here's the paper that contains all the details for our model, our approach, and the training results
The model achieves the following results:
|Dataset||WikiFANE Gold||WikiFANE Gold||WikiFANE Gold||NewsFANE Gold||NewsFANE Gold||NewsFANE Gold|
The model is available on the HuggingFace model page under the name: boda/ANER. Checkpoints are available only in PyTorch at the time.
Use in python:
from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("boda/ANER") model = AutoModelForTokenClassification.from_pretrained("boda/ANER")
Thanks to Arabert for providing the Arabic Bert model, which we used as a base model for our work.
We also would like to thank Prof. Fahd Saleh S Alotaibi at the Faculty of Computing and Information Technology King Abdulaziz University, for providing the dataset which we used to train our model with.
- Downloads last month