Spaces:

BroBro87
/

CloudChat

Sleeping

BroBro87 commited on Feb 17

Commit

1ccb8e5

•

1 Parent(s): dca8708

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -19,7 +19,7 @@ def configure_llama_model():
         model_url=model_url,
         temperature=0.3,
         max_new_tokens=256,
-        context_window=3900,
         model_kwargs={"n_gpu_layers": -1},
         messages_to_prompt=messages_to_prompt,
         completion_to_prompt=completion_to_prompt,

         model_url=model_url,
         temperature=0.3,
         max_new_tokens=256,
+        context_window=2000,
         model_kwargs={"n_gpu_layers": -1},
         messages_to_prompt=messages_to_prompt,
         completion_to_prompt=completion_to_prompt,