Hugging Face's logo

jannesg
/
takalane_nbl_roberta

Fill-Mask
Transformers
PyTorch
JAX
Southern Ndebele
roberta
masked-lm
Inference Endpoints
Model card Files Community
takalane_nbl_roberta / README.md
julien-c's picture
julien-c HF staff
Migrate model card from transformers-repo
196f5f0
preview code
|
raw
history blame
1.29 kB
metadata
language:
  - nr
thumbnail: https://pbs.twimg.com/media/EVjR6BsWoAAFaq5.jpg
tags:
  - nr
  - fill-mask
  - pytorch
  - roberta
  - masked-lm
license: MIT

Takalani Sesame - Ndebele 🇿🇦

Model description

Takalani Sesame (named after the South African version of Sesame Street) is a project that aims to promote the use of South African languages in NLP, and in particular look at techniques for low-resource languages to equalise performance with larger languages around the world.

Intended uses & limitations

How to use 

from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_nbl_roberta")

model = AutoModelWithLMHead.from_pretrained("jannesg/takalane_nbl_roberta")

Limitations and bias

Updates will be added continously to improve performance. This is a very low resource language, results may be poor at first.

Training data

Data collected from https://wortschatz.uni-leipzig.de/en
Sentences: 318M

Training procedure

No preprocessing. Standard Huggingface hyperparameters.

Author

Jannes Germishuys website