miguelcarv
/

phi-1_5-slimorca

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

miguelcarv commited on Jan 17

Commit

df95f8b

•

1 Parent(s): 033e57d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ Output:"""
 with torch.no_grad():
     outputs = model.generate(
         tokenizer(input_text, return_tensors="pt")['input_ids'],
-        max_length=256,
         num_beams = 3,
         eos_token_id = tokenizer.eos_token_id
     )

 with torch.no_grad():
     outputs = model.generate(
         tokenizer(input_text, return_tensors="pt")['input_ids'],
+        max_length=1024,
         num_beams = 3,
         eos_token_id = tokenizer.eos_token_id
     )