Spaces:

huggingchat
/

chat-ui

Running

nsarrazin HF staff commited on Apr 23

Commit

5f4c031

•

1 Parent(s): c5fac96

Add extra stop tokens for phi 3 (#1059)

Files changed (1) hide show

.env.template CHANGED Viewed

@@ -182,7 +182,7 @@ MODELS=`[
       "modelUrl": "https://huggingface.co/microsoft/Phi-3-mini-4k-instruct",
       "preprompt": "",
       "parameters": {
-        "stop": ["</s>", "<|end|>"],
         "max_new_tokens": 1024,
         "truncate": 3071
       },

       "modelUrl": "https://huggingface.co/microsoft/Phi-3-mini-4k-instruct",
       "preprompt": "",
       "parameters": {
+        "stop": ["</s>", "<|end|>", "<|endoftext|>", "<|assistant|>"],
         "max_new_tokens": 1024,
         "truncate": 3071
       },