Andrey Kutuzov commited on
Commit
e33d551
1 Parent(s): acc64ce

Tokenizer config back

Browse files
Files changed (1) hide show
  1. tokenizer_config.json +1 -2
tokenizer_config.json CHANGED
@@ -1,4 +1,3 @@
1
  {
2
- "do_lower_case": false,
3
- "do_basic_tokenize": false
4
  }
1
  {
2
+ "do_lower_case": false
 
3
  }