matsuo-lab
/

weblab-10b-instruction-sft

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

matsuo-lab commited on Aug 23, 2023

Commit

1abfc61

•

1 Parent(s): 388f40d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -82,7 +82,7 @@ with torch.no_grad():
         token_ids.to(model.device),
         max_new_tokens=100,
         do_sample=True,
-        temperature=1.0,
         top_p=0.95,
         pad_token_id=tokenizer.pad_token_id,
         bos_token_id=tokenizer.bos_token_id,

         token_ids.to(model.device),
         max_new_tokens=100,
         do_sample=True,
+        temperature=0.7,
         top_p=0.95,
         pad_token_id=tokenizer.pad_token_id,
         bos_token_id=tokenizer.bos_token_id,