learn-ai

Runtime error

dh-mc commited on Oct 11, 2023

Commit

49e2055

•

1 Parent(s): 37368f6

set repetition_penalty=1.12 for hftgi

Files changed (1) hide show

app_modules/llm_loader.py CHANGED Viewed

@@ -217,7 +217,7 @@ class LLMLoader:
                     top_p=0.95,
                     # typical_p=0.95,
                     temperature=0.01,
-                    repetition_penalty=1.115,
                     callbacks=callbacks,
                     timeout=600,
                     streaming=True,

                     top_p=0.95,
                     # typical_p=0.95,
                     temperature=0.01,
+                    repetition_penalty=1.12,
                     callbacks=callbacks,
                     timeout=600,
                     streaming=True,