Text Generation
Transformers
PyTorch
code
gpt2
custom_code
Eval Results
text-generation-inference
santacoder / tokenizer_config.json
RaymondLi's picture
add special tokens
1354bdd
raw history blame
No virus
102 Bytes
{
"errors": "replace",
"tokenizer_class": "PreTrainedTokenizerFast",
"model_max_length": 2048
}