Spaces:

JimmyK300
/

Qwen2.5-VL-3B-Instruct-Vietamese

Runtime error

prithivMLmods commited on 30 days ago

Commit

a4b01ce

verified ·

1 Parent(s): 26f1812

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -11,7 +11,7 @@ processor = AutoProcessor.from_pretrained(MODEL_ID, trust_remote_code=True)
 model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
     MODEL_ID,
     trust_remote_code=True,
-    torch_dtype=torch.float16
 ).to("cuda").eval()
 @spaces.GPU

 model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
     MODEL_ID,
     trust_remote_code=True,
+    torch_dtype=torch.bfloat16
 ).to("cuda").eval()
 @spaces.GPU