gugarosa's picture
fix(tokenizer): Also updates tokenizer.json to prevent any mismatch.
653ee82 verified