Text Generation
Transformers
PyTorch
Safetensors
English
gpt_neox
Eval Results
Inference Endpoints
text-generation-inference
RedPajama-INCITE-Chat-Instruct-3B-V1 / tokenizer_config.json
acrastt's picture
Upload 6 files
ae5a759
{
"add_prefix_space": false,
"bos_token": "<|endoftext|>",
"clean_up_tokenization_spaces": true,
"eos_token": "<|endoftext|>",
"model_max_length": 2048,
"tokenizer_class": "GPTNeoXTokenizer",
"unk_token": "<|endoftext|>"
}