Chat-with-Bitnet-b1.58-2B-4TMay

Runtime error

suayptalha commited on Apr 20

Commit

c3684ef

verified ·

1 Parent(s): 1eae2f3

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -19,7 +19,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_id)
 model = AutoModelForCausalLM.from_pretrained(
     model_id,
     torch_dtype=torch.bfloat16,
-    device_map="cuda"
 )
 @spaces.GPU

 model = AutoModelForCausalLM.from_pretrained(
     model_id,
     torch_dtype=torch.bfloat16,
+    device_map="auto"
 )
 @spaces.GPU