Fix `model_max_length` in `tokenizer_config.json` (#1)

Browse files

- Fix `model_max_length` in `tokenizer_config.json` (6edb399955389a99eff3a679de91b428a8685887)

Co-authored-by: Santiago Castro <bryant1410@users.noreply.huggingface.co>

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -4,7 +4,7 @@
   "do_basic_tokenize": true,
   "do_lower_case": true,
   "mask_token": "[MASK]",
-  "model_max_length": 1000000000000000019884624838656,
   "never_split": null,
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",

   "do_basic_tokenize": true,
   "do_lower_case": true,
   "mask_token": "[MASK]",
+  "model_max_length": 512,
   "never_split": null,
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",