openthaigpt-1.0.0-7b-AWQ / added_tokens.json
nakcnx's picture
Upload tokenizer
df8f780 verified
raw
history blame contribute delete
94 Bytes
{
"<CLS>": 41070,
"<EOD>": 41072,
"<MASK>": 41073,
"<PAD>": 41074,
"<SEP>": 41071
}