lilchatbot-tokenizer / tokenizer_config.json
divilian's picture
(Fix typo.)
03fa779
raw
history blame contribute delete
78 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast",
"model_max_length": 128
}