Mete Ismayil commited on
Commit
62ca405
β€’
1 Parent(s): 0ec12d5

Move tokenizer files

Browse files
tokenizer/added_tokens.json β†’ added_tokens.json RENAMED
File without changes
tokenizer/merges.txt β†’ merges.txt RENAMED
File without changes
tokenizer/special_tokens_map.json β†’ special_tokens_map.json RENAMED
File without changes
tokenizer/tokenizer_config.json β†’ tokenizer_config.json RENAMED
File without changes
tokenizer/vocab.json β†’ vocab.json RENAMED
File without changes