divakaivan
/

llama3-finetuned-reviewer-kr

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

divakaivan commited on 25 days ago

Commit

bae2fee

•

1 Parent(s): 8367197

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -31,7 +31,7 @@ inputs = tokenizer(
     )
 ], return_tensors = "pt").to("cuda")
-outputs = model.generate(**inputs, max_new_tokens = 64, use_cache = True)
 tokenizer.batch_decode(outputs)
 ```

     )
 ], return_tensors = "pt").to("cuda")
+outputs = model.generate(**inputs, max_new_tokens = 1000, use_cache = True)
 tokenizer.batch_decode(outputs)
 ```