Spaces:

HuggingFaceM4
/

idefics3

Running on Zero

merve HF staff commited on Aug 6

Commit

f4784f8

•

1 Parent(s): 0029ec4

enable fa2

Files changed (1) hide show

app.py CHANGED Viewed

@@ -13,7 +13,7 @@ processor = AutoProcessor.from_pretrained("HuggingFaceM4/Idefics3-8B-Llama3")
 model = Idefics3ForConditionalGeneration.from_pretrained("HuggingFaceM4/Idefics3-8B-Llama3",
         torch_dtype=torch.bfloat16,
-        #_attn_implementation="flash_attention_2",
         trust_remote_code=True).to("cuda")
 BAD_WORDS_IDS = processor.tokenizer(["<image>", "<fake_token_around_image>"], add_special_tokens=False).input_ids

 model = Idefics3ForConditionalGeneration.from_pretrained("HuggingFaceM4/Idefics3-8B-Llama3",
         torch_dtype=torch.bfloat16,
+        _attn_implementation="flash_attention_2",
         trust_remote_code=True).to("cuda")
 BAD_WORDS_IDS = processor.tokenizer(["<image>", "<fake_token_around_image>"], add_special_tokens=False).input_ids