MLP-KTLim
/

llama-3-Korean-Bllossom-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

limhyeonseok commited on May 14

Commit

f361a34

•

1 Parent(s): 36fdb96

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -180,8 +180,7 @@ outputs = model.generate(
     eos_token_id=terminators,
     do_sample=True,
     temperature=0.6,
-    top_p=0.9,
-    repetition_penalty = 1.1
 )
 print(tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True))

     eos_token_id=terminators,
     do_sample=True,
     temperature=0.6,
+    top_p=0.9
 )
 print(tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True))