Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

shreeyad
/

tokenizers-multilingual

Sleeping

App Files Files Community

Fetching metadata from the HF Docker repository...

tokenizers-multilingual / vocab

1 contributor

History: 1 commit

shreeyad's picture

added vocab

502e939 about 1 year ago

tiktoken_cache
added vocab about 1 year ago
gpt-4-vocab-err.txt

745 kB

added vocab about 1 year ago
gpt-4-vocab.txt

957 kB

added vocab about 1 year ago
nllb-vocab.txt

3.08 MB

added vocab about 1 year ago
roberta-vocab.txt

3.33 MB

added vocab about 1 year ago