LDCC
/

LDCC-SOLAR-10.7B

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

krevas commited on Jan 12

Commit

bdd4489

•

1 Parent(s): 5523909

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +2 -0

tokenizer.json CHANGED Viewed

@@ -32165,6 +32165,8 @@
       "벨": 31997,
       "ゼ": 31998,
       "梦": 31999,
       "ㅡㅡ": 32002,
       "ㅜㅜ": 32003,
       "ㅠㅠ": 32004,

       "벨": 31997,
       "ゼ": 31998,
       "梦": 31999,
+      "<|im_end|>": 32000,
+      "<|im_start|>": 32001,
       "ㅡㅡ": 32002,
       "ㅜㅜ": 32003,
       "ㅠㅠ": 32004,