gpt2-turkish-10m / added_tokens.json
cenkersisman's picture
Upload tokenizer
f1bbc8d
raw
history blame
No virus
125 Bytes
{
"(A)": 52005,
"[CLS]": 52002,
"[EOS]": 52000,
"[PAD]": 52001,
"[Q]": 52004,
"[SEP]": 52003,
"[UNK]": 52006
}