matsuo-lab
/

weblab-10b

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

matsuo-lab commited on Aug 23, 2023

Commit

4ae27ec

•

1 Parent(s): 2dd30eb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -71,7 +71,7 @@ with torch.no_grad():
         token_ids.to(model.device),
         max_new_tokens=100,
         do_sample=True,
-        temperature=1.0,
         top_p=0.95,
         pad_token_id=tokenizer.pad_token_id,
         bos_token_id=tokenizer.bos_token_id,

         token_ids.to(model.device),
         max_new_tokens=100,
         do_sample=True,
+        temperature=0.7,
         top_p=0.95,
         pad_token_id=tokenizer.pad_token_id,
         bos_token_id=tokenizer.bos_token_id,