squarelike
/

Gugugo-koen-7B-V1.1

text-generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

squarelike commited on Oct 29, 2023

Commit

ab8d438

•

1 Parent(s): 9a526db

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -75,8 +75,9 @@ def gen(lan="en", x=""):
             return_token_type_ids=False
         ).to("cuda"),
         max_new_tokens=2000,
-        temperature=0.1,
-        do_sample=True,
         stopping_criteria=stopping_criteria
     )
     return tokenizer.decode(gened[0][1:]).replace(prompt+" ", "").replace("</끝>", "")

             return_token_type_ids=False
         ).to("cuda"),
         max_new_tokens=2000,
+        temperature=0.3,
+        # no_repeat_ngram_size=5,
+        num_beams=5,
         stopping_criteria=stopping_criteria
     )
     return tokenizer.decode(gened[0][1:]).replace(prompt+" ", "").replace("</끝>", "")