Spaces:

huggingchat
/

chat-ui

Paused

nsarrazin HF staff commited on Jan 17

Commit

9b5d65a

•

1 Parent(s): 01418cd

Bump max new tokens for NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO (#702)

* Bump max new tokens for NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO

* bumped values a bit higher seems to work ok

Files changed (1) hide show

.env.template CHANGED Viewed

@@ -82,8 +82,8 @@ MODELS=`[
         "top_p": 0.95,
         "repetition_penalty": 1,
         "top_k": 50,
-        "truncate": 3072,
-        "max_new_tokens": 512,
         "stop": ["<|im_end|>"]
       }
     },

         "top_p": 0.95,
         "repetition_penalty": 1,
         "top_k": 50,
+        "truncate": 24576,
+        "max_new_tokens": 2048,
         "stop": ["<|im_end|>"]
       }
     },