Rename tokenizer_2/tokenizer_2_tokenizer_config.json to tokenizer_2/tokenizer_config.json f895b2b dataautogpt3 commited on Dec 23, 2023
Rename tokenizer_2/tokenizer_2_special_tokens_map.json to tokenizer_2/special_tokens_map.json 7728e8f dataautogpt3 commited on Dec 23, 2023
Rename tokenizer_2/tokenizer_2_merges.txt to tokenizer_2/merges.txt fc8b3e5 dataautogpt3 commited on Dec 23, 2023
Rename tokenizer_2/tokenizer_2_added_tokens.json to tokenizer_2/added_tokens.json 2a699fb dataautogpt3 commited on Dec 23, 2023
Rename tokenizer_2/tokenizer_2_vocab.json to tokenizer_2/vocab.json 08d6c94 dataautogpt3 commited on Dec 23, 2023