MediaTek-Research
/

Llama-Breeze2-8B-Instruct

Model card Files Files and versions Community

YC-Chen commited on Jan 23

Commit

3112358

·

verified ·

1 Parent(s): 5ebc14b

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -36,7 +36,9 @@ model = AutoModel.from_pretrained(
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
     trust_remote_code=True,
-    device_map='auto').eval()
 tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True, use_fast=False)

     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
     trust_remote_code=True,
+    device_map='auto',
+    img_context_token_id=128212
+).eval()
 tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True, use_fast=False)