xu-song's picture
update
751936e
raw
history blame
168 Bytes
{
"pad_token": "<|endoftext|>",
"unk_token": "<|endoftext|>",
"bos_token": "<|startoftext|>",
"eos_token": "<|endoftext|>",
"do_clean_text": false
}