lichenglu commited on
Commit
95739ab
β€’
1 Parent(s): a179965

Move tokenizer files to root

Browse files
.gitignore CHANGED
@@ -1,4 +1,5 @@
1
  *.ipynb
2
  .ipynb_checkpoints
3
  */.ipynb_checkpoints/*
4
- .virtual_documents
 
1
  *.ipynb
2
  .ipynb_checkpoints
3
  */.ipynb_checkpoints/*
4
+ .virtual_documents
5
+ .DS_Store
tokenizer/added_tokens.json β†’ added_tokens.json RENAMED
File without changes
tokenizer/merges.txt β†’ merges.txt RENAMED
File without changes
tokenizer/special_tokens_map.json β†’ special_tokens_map.json RENAMED
File without changes
tokenizer/tokenizer.json β†’ tokenizer.json RENAMED
File without changes
tokenizer/tokenizer_config.json β†’ tokenizer_config.json RENAMED
File without changes
tokenizer/vocab.json β†’ vocab.json RENAMED
File without changes