multivariable_baseline-stage2 / added_tokens.json
Chakita's picture
Upload tokenizer
c484ae0
{
"<BRG>": 50257,
"<|keywordtext|>": 50258,
"<|padtext|>": 50260,
"<|septext|>": 50261,
"<|startoftext|>": 50259
}