Spaces:

harsh-manvar
/

llama-2-7b-chat-test

Runtime error

harsh-manvar commited on Sep 17, 2023

Commit

698b304

•

1 Parent(s): 3da0af1

Update model.py

Files changed (1) hide show

model.py CHANGED Viewed

@@ -69,8 +69,6 @@ def run(message: str,
         top_k=top_k,
         temperature=temperature,
         num_beams=1,
-        bits=4,
-        groupsize=128,
     )
     t = Thread(target=model.generate, kwargs=generate_kwargs)
     t.start()

         top_k=top_k,
         temperature=temperature,
         num_beams=1,
     )
     t = Thread(target=model.generate, kwargs=generate_kwargs)
     t.start()