rembert / tokenizer.json

Commit History

Update tokenizer config to match latest bugfixes, add tokenizer.json
e33b2da

iwontbecreative commited on