BEE-spoke-data
/

smol_llama-220M-openhermes

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

pszemraj commited on Jan 3

Commit

364d895

•

1 Parent(s): 9694b44

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -12,8 +12,8 @@ inference:
     top_k: 50
     min_new_tokens: 2
     max_new_tokens: 96
-    repetition_penalty: 1.04
-    no_repeat_ngram_size: 6
     epsilon_cutoff: 0.0006
 widget:
   - text: >
@@ -74,8 +74,8 @@ inference:
     top_k: 50
     min_new_tokens: 2
     max_new_tokens: 96
-    repetition_penalty: 1.04
-    no_repeat_ngram_size: 6
     epsilon_cutoff: 0.0006
 ```

     top_k: 50
     min_new_tokens: 2
     max_new_tokens: 96
+    repetition_penalty: 1.01
+    no_repeat_ngram_size: 5
     epsilon_cutoff: 0.0006
 widget:
   - text: >
     top_k: 50
     min_new_tokens: 2
     max_new_tokens: 96
+    repetition_penalty: 1.01
+    no_repeat_ngram_size: 5
     epsilon_cutoff: 0.0006
 ```