IndicBERTv2-MLM-Sam-TLM / tokenizer_config.json
sumanthd's picture
add tokenizer
4e3889f
raw history blame
No virus
51 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast"
}