File size: 186 Bytes
b0493e1
 
 
 
 
 
 
 
 
27e62e8
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
---
language: 
  - bal
tags:
- balochi
- tokenizer
license: "apache-2.0"
---

# Balochi Tokenizers

Custom tokenizers for the Balochi language.

- 🤗 Tokenizer
- Spacy Tokenizer (WIP)