Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
01-ai
/
Yi-34B-200K
like
313
Text Generation
Transformers
PyTorch
Safetensors
llama
text-generation-inference
Inference Endpoints
arxiv:
2403.04652
arxiv:
2311.16502
arxiv:
2401.11944
License:
apache-2.0
Model card
Files
Files and versions
Community
21
Train
Deploy
Use this model
81f2d13
Yi-34B-200K
/
tokenizer_config.json
cArlIcon
add Yi-34B-200K
68bff3e
10 months ago
raw
Copy download link
history
blame
No virus
201 Bytes
{
"auto_map"
:
{
"AutoTokenizer"
:
[
"tokenization_yi.YiTokenizer"
,
null
]
}
,
"add_bos_token"
:
false
,
"add_eos_token"
:
false
,
"model_max_length"
:
200000
,
"tokenizer_class"
:
"YiTokenizer"
}