MrOvkill
/

Phi-3-Instruct-Bloated

Text Generation

microsoft/Phi-3-mini-128k-instruct

NexaAIDev/Octopus-v4

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MrOvkill commited on May 11

Commit

c1c9cfa

•

1 Parent(s): e9eaf88

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -32,7 +32,7 @@ class EndpointHandler():
             })
         res = PROMPT_FORMAT.format(do_sample=False)
-        retrurn model(
             res,
             max_new_tokens=max_new_tokens,
             do_sample=False

             })
         res = PROMPT_FORMAT.format(do_sample=False)
+        return model(
             res,
             max_new_tokens=max_new_tokens,
             do_sample=False