suehyunpark
/

potpourri-8b-inst-fft-induction-bc-trajectory-max1-per-task-tool-token-fix

Text Generation

Generated from Trainer

alignment-handbook

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

suehyunpark commited on 7 days ago

Commit

15c6b57

•

1 Parent(s): b684128

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -2058,7 +2058,7 @@
     "input_ids",
     "attention_mask"
   ],
-  "model_max_length": 2048,
   "pad_token": "<|finetune_right_pad_id|>",
   "stride": 0,
   "tokenizer_class": "PreTrainedTokenizerFast",

     "input_ids",
     "attention_mask"
   ],
+  "model_max_length": 131072,
   "pad_token": "<|finetune_right_pad_id|>",
   "stride": 0,
   "tokenizer_class": "PreTrainedTokenizerFast",