AmhWordPieceTokenizer / added_tokens.json
israel's picture
add tokenizer
19163f1
{
"[PAD]": 30000
}