AmhWordPieceTokenizer / added_tokens.json
israel's picture
add tokenizer
19163f1
raw history blame
No virus
21 Bytes
{
"[PAD]": 30000
}