Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
zirui3
/
llm-zh-tokenizer
like
0
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
Edit model card
Chinese tokenizer trained on Baike by using BPE algorithm
Downloads last month
0
Unable to determine this model's library. Check the
docs
.
