Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt f51022e verified ccc8 commited on Apr 5, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 0c0f5d6 verified ccc8 commited on Apr 5, 2024
Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json 8efb485 verified ccc8 commited on Apr 5, 2024