AlignmentLab-AI
/

teensyorca

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Alignment-Lab-AI commited on Jan 7

Commit

4b45ef4

•

1 Parent(s): b120c04

Update generation_config.json

Files changed (1) hide show

generation_config.json +1 -1

generation_config.json CHANGED Viewed

@@ -1,7 +1,7 @@
 {
   "bos_token_id": 1,
   "eos_token_id": 2,
-  "max_length": 2048,
   "pad_token_id": 0,
   "transformers_version": "4.36.2"
 }

 {
   "bos_token_id": 1,
   "eos_token_id": 2,
+  "max_length": 8096,
   "pad_token_id": 0,
   "transformers_version": "4.36.2"
 }