openthaigpt-mgpt-pantipwiki-poc / added_tokens.json
kobkrit's picture
Upload tokenizer
c98b679
raw
history blame contribute delete
No virus
53 Bytes
{
"<|pad|>": 100001,
"<|startoftext|>": 100000
}