Deploy-FastAPI-Applications

Runtime error

moraxgiga commited on Feb 7

Commit

e617887

•

1 Parent(s): ddf9938

Update TextGen/router.py

Files changed (1) hide show

TextGen/router.py CHANGED Viewed

@@ -35,5 +35,5 @@ def inference(item: Validation):
     return {
         "embeddings": embeddings,
         "time_taken": f"{time_taken:.2f} seconds",
-        "Number_of_sentence_processed": len(x)
     }

     return {
         "embeddings": embeddings,
         "time_taken": f"{time_taken:.2f} seconds",
+        "Number_of_sentence_processed": len(item.prompt)
     }