stabilityai
/

stablelm-tuned-alpha-7b

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

hardmaru commited on Apr 19, 2023

Commit

a444b43

•

1 Parent(s): 3123a2b

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -43,6 +43,9 @@ inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
 tokens = model.generate(
   **inputs,
   max_new_tokens=64,
 print(tokenizer.decode(tokens[0], skip_special_tokens=True))
 ```

 tokens = model.generate(
   **inputs,
   max_new_tokens=64,
+  temperature=0.7,
+  do_sample=True,
+)
 print(tokenizer.decode(tokens[0], skip_special_tokens=True))
 ```