Spaces:

Vision-CAIR
/

minigpt4

Running on A10G

Vision-CAIR commited on Apr 19, 2023

Commit

19f67eb

•

1 Parent(s): 3af054e

Update minigpt4/models/mini_gpt4.py

Files changed (1) hide show

minigpt4/models/mini_gpt4.py CHANGED Viewed

@@ -129,7 +129,7 @@ class MiniGPT4(Blip2Base):
         self.vit_to_cpu()
         image = image.to("cpu")
         with self.maybe_autocast():
-            image_embeds = self.ln_vision(self.visual_encoder(image))
             image_atts = torch.ones(image_embeds.size()[:-1], dtype=torch.long).to(
                 image.device
             )

         self.vit_to_cpu()
         image = image.to("cpu")
         with self.maybe_autocast():
+            image_embeds = self.ln_vision(self.visual_encoder(image)).to(device)
             image_atts = torch.ones(image_embeds.size()[:-1], dtype=torch.long).to(
                 image.device
             )