tbs17 commited on
Commit
6f849e9
1 Parent(s): ed2a04c

add tokenizer files 2

Browse files
Files changed (2) hide show
  1. tokenizer.json +0 -0
  2. tokenizer_config.json +3 -3
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
tokenizer_config.json CHANGED
@@ -1,3 +1,3 @@
1
- {
2
- do_lower_case: true
3
- }
1
+ {
2
+ "do_lower_case": true
3
+ }