BAAI
/

Bunny-Llama-3-8B-V

Text Generation

Model card Files Files and versions Community

BoyaWu10 commited on 27 days ago

Commit

45417f7

•

1 Parent(s): dfa75da

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -78,7 +78,9 @@ output_ids = model.generate(
     input_ids,
     images=image_tensor,
     max_new_tokens=100,
-    use_cache=True)[0]
 print(tokenizer.decode(output_ids[input_ids.shape[1]:], skip_special_tokens=True).strip())
 ```

     input_ids,
     images=image_tensor,
     max_new_tokens=100,
+    use_cache=True,
+    repetition_penalty=1.0 # increase this to avoid chattering
+)[0]
 print(tokenizer.decode(output_ids[input_ids.shape[1]:], skip_special_tokens=True).strip())
 ```