Spaces:

nara-meta-lab
/

nallm-test

Sleeping

Gyu-min Nigel Lee commited on Aug 7

Commit

0ff7839

•

1 Parent(s): dbd1d8f

revised pipe

Files changed (1) hide show

app.py CHANGED Viewed

@@ -29,9 +29,9 @@ def respond(
     output = pipe(
         messages,
-        max_tokens=max_tokens,
-        stream=True,
         temperature=temperature,
         top_p=top_p,
     )
     return output[0]["generated_text"]

     output = pipe(
         messages,
+        max_new_tokens=max_tokens,
         temperature=temperature,
+        return_full_text=False,
         top_p=top_p,
     )
     return output[0]["generated_text"]