BramVanroy
/

Llama-2-13b-chat-dutch

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

BramVanroy commited on Dec 4, 2023

Commit

4126739

•

1 Parent(s): 5d476c4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -68,7 +68,7 @@ prompt = pipe.tokenizer.apply_chat_template(
 generated = pipe(
     prompt,
     do_sample=True,
-    max_new_tokens=128,
     return_full_text=False
 )

 generated = pipe(
     prompt,
     do_sample=True,
+    max_new_tokens=64,
     return_full_text=False
 )