Hugging Face model: olaverse/otk-bpe-50k
Author: olaverse
Created: 2026-05-24 13:30:25
Last modified: 2026-05-28 17:33:32
Library: tokenizers
Likes: 0 | Downloads: 0
Tags: tokenizers, BPE, tokenizer, nigerian-languages, yoruba, igbo, hausa, pidgin, naija, dataset:google/WaxalNLP, dataset:wikimedia/wikipedia, dataset:masakhane/masakhanews, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
library_name: tokenizers
tags: BPE, tokenizer, nigerian-languages, yoruba, igbo, hausa, pidgin, naija
datasets: google/WaxalNLP, wikimedia/wikipedia, masakhane/masakhanews