Edit model card
drawing

DziriBERT Sentiment

DziriBERT is the first Transformer-based Language Model that has been pre-trained specifically for the Algerian Dialect. It handles Algerian text contents written using both Arabic and Latin characters. This is a fine-tuned version that is ready to use for sentiment classification.

For more information, please visit our paper: https://arxiv.org/pdf/2109.12346.pdf.

How to use

from transformers import BertTokenizer, BertForSequenceClassification

tokenizer = BertTokenizer.from_pretrained("alger-ia/dziribert_sentiment")
model = BertForSequenceClassification.from_pretrained("alger-ia/dziribert_sentiment")

You can find a fine-tuning script in our Github repo: https://github.com/alger-ia/dziribert

How to cite

@article{dziribert,
  title={DziriBERT: a Pre-trained Language Model for the Algerian Dialect},
  author={Abdaoui, Amine and Berrimi, Mohamed and Oussalah, Mourad and Moussaoui, Abdelouahab},
  journal={arXiv preprint arXiv:2109.12346},
  year={2021}
}

Contact

Please contact amine.abdaoui.nlp@gmail.com for any question, feedback or request.

Downloads last month
92
Safetensors
Model size
124M params
Tensor type
I64
·
F32
·