MrOvkill
/

Phi-3-Instruct-Bloated

Text Generation

microsoft/Phi-3-mini-128k-instruct

NexaAIDev/Octopus-v4

Inference Endpoints

Model card Files Files and versions Community

MrOvkill commited on May 11

Commit

f72c5f5

•

1 Parent(s): 3c57069

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -37,7 +37,7 @@ class EndpointHandler():
                 "reason": "max_length was passed as something that was absolutely not a plain old int"
             })
-        res = PROMPT_FORMAT.format(do_sample=False)
         return model(
             res,
             max_new_tokens=max_new_tokens,

                 "reason": "max_length was passed as something that was absolutely not a plain old int"
             })
+        res = PROMPT_FORMAT.format(inputs=data['inputs'])
         return model(
             res,
             max_new_tokens=max_new_tokens,