Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
tspersian
/
mana_tokenizer
like
0
Persian
English
Arabic
License:
mit
Model card
Files
Files and versions
Community
main
mana_tokenizer
1 contributor
History:
16 commits
tspersian
control
81c873e
4 months ago
.gitattributes
Safe
88 Bytes
Re-add model and vocab files with LFS
6 months ago
.gitignore
Safe
13 Bytes
package
5 months ago
README.md
Safe
2.28 kB
regex
4 months ago
__init__.py
Safe
133 Bytes
package
5 months ago
base.py
Safe
14.6 kB
package
5 months ago
benchmark.py
Safe
3.49 kB
improve
5 months ago
helper.py
Safe
3.27 kB
scripts
5 months ago
mana.model
Safe
2.92 MB
LFS
regex
4 months ago
mana.vocab
Safe
11.1 MB
LFS
control
4 months ago
mana_tokenizer.py
Safe
6.36 kB
improve
5 months ago
test.py
Safe
229 Bytes
package
5 months ago