Spaces:

louisbrulenaudet
/

Pearl-7B

Sleeping

louisbrulenaudet commited on Mar 22

Commit

6718013

•

1 Parent(s): bcb35c6

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -51,7 +51,7 @@ def setup(
     model = AutoModelForCausalLM.from_pretrained(
         model_id,
-        torch_dtype=torch.bfloat16,
         device_map="auto"
     )

     model = AutoModelForCausalLM.from_pretrained(
         model_id,
+        torch_dtype=torch.float16,
         device_map="auto"
     )