gpt-sw3-6.7b-v2-instruct / tokenizer_config.json
Ekgren's picture
Create tokenizer_config.json (#3)
c42fd44
{
"model_max_length": 2048,
"padding_side": "left",
"truncation_side": "left"
}