SaulLu
/

albert-bn-dev

Model card Files Files and versions Community

albert-bn-dev / tokenizer_config.json

Commit History

tokenizer v2 - fix user defined symbols

bf3a9c0

SaulLu commited on Apr 25, 2021

First version of the Bengali Albert tokenizer

81c2f45

SaulLu commited on Apr 21, 2021