gpt2-mawps-pen / added_tokens.json
yashichawla's picture
Tokenizer: Epoch 1
715d245
raw
history blame contribute delete
324 Bytes
{
"<BRG>": 50259,
"<|keywordtext|>": 50257,
"<|padtext|>": 50261,
"<|questiontext|>": 50258,
"<|septext|>": 50262,
"<|startoftext|>": 50260,
"N_00": 50263,
"N_01": 50264,
"N_02": 50265,
"N_03": 50266,
"N_04": 50267,
"N_05": 50268,
"N_06": 50269,
"N_07": 50270,
"N_08": 50271,
"N_09": 50272
}