chaoyi-wu
/

MedLLaMA_13B

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

chaoyi-wu commited on May 20, 2023

Commit

893557e

•

1 Parent(s): 93e4696

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -29,4 +29,5 @@ batch = tokenizer(
         )
 with torch.no_grad():
     generated = model.generate(inputs = batch["input_ids"], max_length=200, do_sample=True, top_k=50)
-    print('model predict: ',tokenizer.decode(generated[0]))

         )
 with torch.no_grad():
     generated = model.generate(inputs = batch["input_ids"], max_length=200, do_sample=True, top_k=50)
+    print('model predict: ',tokenizer.decode(generated[0]))
+```