Spaces:

danielsteinigen
/

domain-detection

Paused

danielsteinigen commited on Apr 5, 2023

Commit

d9b5a69

•

1 Parent(s): 9d582a8

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -23,7 +23,7 @@ def make_inference(utterance):
     )
     with torch.cuda.amp.autocast():
-        output_tokens = model.generate(**batch, max_new_tokens=1)
     return tokenizer.decode(output_tokens[0], skip_special_tokens=True)

     )
     with torch.cuda.amp.autocast():
+        output_tokens = model.generate(**batch, max_new_tokens=2)
     return tokenizer.decode(output_tokens[0], skip_special_tokens=True)