skt
/

A.X-Encoder-base

Text Classification

Eval Results (legacy)

text-embeddings-inference

Model card Files Files and versions

yjoonjang commited on 10 days ago

Commit

c0288a3

·

verified ·

1 Parent(s): b5c71f3

Set tokenizer "model_max_length" property to 16384

This information is different with the [README](https://huggingface.co/skt/A.X-Encoder-base#ax-encoder-highlights)

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -312,7 +312,7 @@
   "eos_token": "<\\s>",
   "extra_special_tokens": {},
   "mask_token": "<mask>",
-  "model_max_length": 1024,
   "pad_token": "<pad>",
   "sep_token": "<sep>",
   "strip_accents": null,

   "eos_token": "<\\s>",
   "extra_special_tokens": {},
   "mask_token": "<mask>",
+  "model_max_length": 16384,
   "pad_token": "<pad>",
   "sep_token": "<sep>",
   "strip_accents": null,