Spaces:

vaishakgkumar
/

stablemed2

Runtime error

vaishakgkumar commited on Dec 30, 2023

Commit

5c24ca1

•

1 Parent(s): 12555c1

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -77,7 +77,7 @@ class ChatBot:
         )
         # Generate a response using the model
-        tokens = model.generate(
             inputs.to(model.device),
             max_new_tokens=250,
             temperature=0.8,

         )
         # Generate a response using the model
+        tokens = peft_model.generate(
             inputs.to(model.device),
             max_new_tokens=250,
             temperature=0.8,