nb-npsc-test / added_tokens.json
Jethuestad's picture
add tokenizer
403fdf4
{
"</s>": 54,
"<s>": 53,
"[PAD]": 55
}