stabilityai
/

stablelm-2-1_6b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

jon-tow commited on Jan 19

Commit

9f2def9

•

1 Parent(s): ca32832

fix: add default special tokens

Files changed (1) hide show

tokenizer_config.json +0 -1

tokenizer_config.json CHANGED Viewed

@@ -6,7 +6,6 @@
       null
     ]
   },
-  "bos_token": "<|endoftext|>",
   "eos_token": "<|endoftext|>",
   "pad_token": "<|endoftext|>"
 }

       null
     ]
   },
   "eos_token": "<|endoftext|>",
   "pad_token": "<|endoftext|>"
 }