Xenova
/

uform-vl-multilingual

Transformers.js

Model card Files Files and versions Community

Xenova HF staff commited on Jan 2

Commit

beba4cf

•

1 Parent(s): 9895a6f

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -46,7 +46,7 @@
   "do_basic_tokenize": true,
   "do_lower_case": true,
   "mask_token": "[MASK]",
-  "model_max_length": 1000000000000000019884624838656,
   "never_split": null,
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",

   "do_basic_tokenize": true,
   "do_lower_case": true,
   "mask_token": "[MASK]",
+  "model_max_length": 77,
   "never_split": null,
   "pad_token": "[PAD]",
   "sep_token": "[SEP]",