Felladrin
/

llama2_xs_460M_experimental_platypus

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Felladrin commited on Nov 26, 2023

Commit

6d5c9b7

•

1 Parent(s): 84e2ccb

Update the inference parameters

Files changed (1) hide show

README.md +5 -2

README.md CHANGED Viewed

@@ -22,8 +22,11 @@ widget:
       ### Assistant:
 inference:
   parameters:
-    max_new_tokens: 64
-    repetition_penalty: 1.18
 ---
 # ahxt's llama2_xs_460M_experimental trained on the Open-Platypus dataset

       ### Assistant:
 inference:
   parameters:
+    max_new_tokens: 32
+    repetition_penalty: 1.15
+    do_sample: true
+    temperature: 0.5
+    top_p: 0.5
 ---
 # ahxt's llama2_xs_460M_experimental trained on the Open-Platypus dataset