pszemraj commited on
Commit
0e7d5ab
1 Parent(s): abc0285

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md CHANGED
@@ -60,3 +60,29 @@ Output on the text above ^. The inference API is set to sample with low temp so
60
 
61
 
62
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/60bccec062080d33f875cd0c/0nFP2jsBkritnryKmI8NV.png)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
 
61
 
62
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/60bccec062080d33f875cd0c/0nFP2jsBkritnryKmI8NV.png)
63
+
64
+ Note that the inference API parameters used here are an initial educated guess, and may be updated over time:
65
+
66
+ ```yml
67
+ inference:
68
+ parameters:
69
+ do_sample: true
70
+ renormalize_logits: true
71
+ temperature: 0.25
72
+ top_p: 0.95
73
+ top_k: 50
74
+ min_new_tokens: 2
75
+ max_new_tokens: 96
76
+ repetition_penalty: 1.04
77
+ no_repeat_ngram_size: 6
78
+ epsilon_cutoff: 0.0006
79
+ ```
80
+
81
+ Feel free to experiment with the parameters using the model in Python and let us know if you have improved results with other params!
82
+
83
+ ## Data
84
+
85
+ Note that **this checkpoint** was fine-tuned on `teknium/openhermes`, which is generated/synthetic data by an OpenAI model. This means usage of this checkpoint should follow their terms of use: https://openai.com/policies/terms-of-use
86
+
87
+
88
+ ---