SaulLu
/

bengali-tokenizer-v2

Model card Files Files and versions Community

bengali-tokenizer-v2 / tokenizer.json

SaulLu's picture

set lstrip to false

beaff1b about 3 years ago

No virus

1.72 MB

File too large to display, you can check the raw version instead.