bigcode
/

santacoder

Text Generation

text-generation-inference

Model card Files Files and versions Community

santacoder / tokenizer_config.json

loubnabnl's picture

loubnabnl HF staff

Update tokenizer (#11)

cd86b97 over 1 year ago

raw history blame

No virus

102 Bytes

	{
	"errors": "replace",
	"tokenizer_class": "PreTrainedTokenizerFast",
	"model_max_length": 2048
	}