Maximum sequence length for a Llama 2 model is 4096 (#3)

Browse files

- Maximum sequence length for a Llama 2 model is 4096 (d3850bcee664af47e31440c03bd13adc0a878c1a)

Co-authored-by: Tom Jobbins <TheBloke@users.noreply.huggingface.co>

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -19,7 +19,7 @@
     "single_word": false
   },
   "legacy": false,
-  "model_max_length": 2000,
   "pad_token": null,
   "padding_side": "right",
   "sp_model_kwargs": {},

     "single_word": false
   },
   "legacy": false,
+  "model_max_length": 4096,
   "pad_token": null,
   "padding_side": "right",
   "sp_model_kwargs": {},