🚀 Models 🔥 Datasets ⚡️ Pricing
🔥 Sign in
Back to all models
Model: jannesg/takalane_nbl_roberta
pytorch roberta masked-lm nr fill-mask license:mit
Model card Files and versions Use in transformers

How to use this model directly from the 🤗/transformers library: 

					
Copy to clipboard

						from transformers import AutoTokenizer, AutoModelForMaskedLM
						
						tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_nbl_roberta")
						
						model = AutoModelForMaskedLM.from_pretrained("jannesg/takalane_nbl_roberta")
See raw config file

How to clone the model repo 

					
Copy to clipboard

					git lfs install
					git clone https://huggingface.co/jannesg/takalane_nbl_roberta
					

						# if you want to clone without large files – just their pointers
						# prepend your git clone with the following env var:
					

					GIT_LFS_SKIP_SMUDGE=1
Done
fill-mask mask_token: <mask>
Query this model
🔥 This model is currently loaded and running on the Inference API. ⚠️ This model could not be loaded by the inference API. ⚠️ This model can be loaded on the Inference API on-demand.
JSON Output
API endpoint  

⚡️ Upgrade your account to access the Inference API

Share Copied link to clipboard

Contributed by

jannesg Jannes Germishuys
11 models
Hosted on huggingface.co

Takalani Sesame - Ndebele 🇿🇦

Model description

Takalani Sesame (named after the South African version of Sesame Street) is a project that aims to promote the use of South African languages in NLP, and in particular look at techniques for low-resource languages to equalise performance with larger languages around the world.

Intended uses & limitations

How to use

from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_nbl_roberta")

model = AutoModelWithLMHead.from_pretrained("jannesg/takalane_nbl_roberta")

Limitations and bias

Updates will be added continously to improve performance. This is a very low resource language, results may be poor at first.

Training data

Data collected from https://wortschatz.uni-leipzig.de/en
Sentences: 318M

Training procedure

No preprocessing. Standard Huggingface hyperparameters.

Author

Jannes Germishuys website