Hugging Face model: Neon-tech/Tokenizers
Author: Neon-tech
Created: 2026-07-27 23:17:58
Last modified: 2026-07-28 06:05:32
Likes: 0 | Downloads: 0
Tags: Tokenizers, BPE, en, ig, ja, ar, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
language: en, ig, ja, ar
tags: Tokenizers, BPE