Spaces:

biodatlab
/

NBDT-Recommendation-Engine

Runtime error

atrytone commited on Jun 27, 2023

Commit

0fde004

•

1 Parent(s): 32e3ff2

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -14,7 +14,7 @@ tokenizer = LlamaTokenizer.from_pretrained("samwit/koala-7b")
 base_model = LlamaForCausalLM.from_pretrained(
     "samwit/koala-7b",
     load_in_8bit=True,
-    device='cpu',
     device_map='auto',
 )

 base_model = LlamaForCausalLM.from_pretrained(
     "samwit/koala-7b",
     load_in_8bit=True,
+    device=-1,
     device_map='auto',
 )