IDMGSP-Galactica-TRAIN / special_tokens_map.json
qwenzoo's picture
Upload tokenizer
63d275a
raw
history blame
50 Bytes
{
"eos_token": "</s>",
"pad_token": "<pad>"
}