albert-tokenizer-without-normalizer / tokenizer_config.json
SaulLu's picture
add modified albert tokenizer
67b371b
raw
history blame contribute delete
No virus
43 Bytes
{
"tokenizer_class": "AlbertTokenizer"
}