IndicBERTv2-MLM-Sam-TLM / tokenizer_config.json
sumanthd's picture
add tokenizer
4e3889f
{
"tokenizer_class": "PreTrainedTokenizerFast"
}