Spaces:

Ankitajadhav
/

Whats_Cooking

Runtime error

Ankitajadhav commited on Jul 7, 2024

Commit

aa60f73

verified ·

1 Parent(s): b9e2b4f

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -17,7 +17,7 @@ from transformers import AutoTokenizer, AutoModelForCausalLM
 torch.random.manual_seed(0)
 model = AutoModelForCausalLM.from_pretrained(
     "microsoft/Phi-3-mini-4k-instruct",
-    device_map="cpu",
     torch_dtype="auto",
     trust_remote_code=True,
 )

 torch.random.manual_seed(0)
 model = AutoModelForCausalLM.from_pretrained(
     "microsoft/Phi-3-mini-4k-instruct",
+    low_cpu_mem_usage=True,
     torch_dtype="auto",
     trust_remote_code=True,
 )