IndicBART / added_tokens.json

draj

Added tokenizer and model in a single repo.

6a40a8b over 2 years ago

No virus

221 Bytes

{"<s>": 64000, "</s>": 64001, "<2as>": 64002, "<2bn>": 64003, "<2en>": 64004, "<2gu>": 64005, "<2hi>": 64006, "<2kn>": 64007, "<2ml>": 64008, "<2mr>": 64009, "<2or>": 64010, "<2pa>": 64011, "<2ta>": 64012, "<2te>": 64013}