SaulLu
/

bengali-tokenizer

Model card Files Files and versions Community

bengali-tokenizer / tokenizer.json

SaulLu's picture

tokenizer v2- include normalization discussed with Bengali community

9ff1d40 about 3 years ago

No virus

1.72 MB

File too large to display, you can check the raw version instead.