01-ai
/

Yi-1.5-34B-32K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mia Xia commited on Jun 5

Commit

2c03a29

•

1 Parent(s): f71d597

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +6 -6

tokenizer.json CHANGED Viewed

@@ -2116,17 +2116,17 @@
         },
         "content": " "
       },
-      {
-        "type": "Strip",
-        "content": " ",
-        "start": 1,
-        "stop": 0
-      },
       {
         "type": "ByteFallback"
       },
       {
         "type": "Fuse"
       }
     ]
   },

         },
         "content": " "
       },
       {
         "type": "ByteFallback"
       },
       {
         "type": "Fuse"
+      },
+      {
+        "type": "Strip",
+        "content": " ",
+        "start": 1,
+        "stop": 0
       }
     ]
   },