Update README.md

Updated recommended settings and license info

README.md

@@ -22,18 +22,18 @@ This model was designed for roleplaying and storytelling and I think it does wel
 
 ### Sampler Tips
 
-I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
-
-I find this model performs reasonably well at 8192 context but you will likely get better results at 4096 - 6144 context.
-
-Experiment with any and all of the settings below, but trust me on a few points:
-* I think this model performs best with Min-P in a range of 0.6 - 0.8 with temperature around 1.0 - 1.2.
-* Frequency Penalty set to 0.01 is like adding a dash of salt to the dish. Go higher at your own peril. 0 is fine too, but gosh I like 0.01.
+* I recommend keeping your max context to around 6144 tokens, although you can push higher if you don't mind some decrease in coherence.
+* I recommend using Quadratic Sampling (i.e. smoothing factor) as it's good stuff. Experiment with values between 0.2 and 0.5.
+* I recommend using Min-P. This model seems to work well with Min-P values in the entire range from low settings like 0.05 to high settings like 0.9 when paired with smoothing factor. Experiment to find your best setting.
+* You can enable dynamic temperature if you want, but that adds yet another variable to consider and I find it's unnecessary with you're already using Min-P and smoothing factor.
+* You don't *need* to use a high repetition penalty with this model, but it tolerates high rep penalty, so experiment to find the right value for your preferences.
+  
+Experiment with any and all of the settings below! I'm not a sampler wizard, and what suits my preferences may not suit yours.
 
 If you save the below settings as a .json file, you can import them directly into Silly Tavern.
 ```
 {
-    "temp": 1.15,
+    "temp": 1,
     "temperature_last": true,
     "top_p": 1,
     "top_k": 0,
@@ -42,26 +42,31 @@ If you save the below settings as a .json file, you can import them directly int
     "epsilon_cutoff": 0,
     "eta_cutoff": 0,
     "typical_p": 1,
-    "min_p": 0.8,
-    "rep_pen": 1.08,
-    "rep_pen_range": 0,
+    "min_p": 0.35,
+    "rep_pen": 1.15,
+    "rep_pen_range": 2800,
     "no_repeat_ngram_size": 0,
     "penalty_alpha": 0,
     "num_beams": 1,
     "length_penalty": 1,
     "min_length": 0,
     "encoder_rep_pen": 1,
-    "freq_pen": 0.01,
+    "freq_pen": 0,
     "presence_pen": 0,
     "do_sample": true,
     "early_stopping": false,
+    "dynatemp": false,
+    "min_temp": 0.8,
+    "max_temp": 1.35,
+    "dynatemp_exponent": 1,
+    "smoothing_factor": 0.4,
     "add_bos_token": true,
     "truncation_length": 2048,
     "ban_eos_token": false,
     "skip_special_tokens": true,
     "streaming": true,
     "mirostat_mode": 0,
-    "mirostat_tau": 5,
+    "mirostat_tau": 2,
     "mirostat_eta": 0.1,
     "guidance_scale": 1,
     "negative_prompt": "",
@@ -69,8 +74,6 @@ If you save the below settings as a .json file, you can import them directly int
     "banned_tokens": "",
     "ignore_eos_token_aphrodite": false,
     "spaces_between_special_tokens_aphrodite": true,
-    "type": "ooba",
-    "legacy_api": false,
     "sampler_order": [
         6,
         0,
@@ -80,57 +83,58 @@ If you save the below settings as a .json file, you can import them directly int
         2,
         5
     ],
+    "logit_bias": [],
     "n": 1,
     "rep_pen_size": 0,
-    "genamt": 550,
-    "max_length": 4096
+    "genamt": 500,
+    "max_length": 6144
 }
 ```
 
 ### Prompting Tips
 
-Try the following context template for use in SillyTavern. It might help. If you save the text as a .json file, you can import it directly.
+Try the following context template for use in SillyTavern. It might help, although it's a little heavy on tokens. If you save the text as a .json file, you can import it directly.
 
 ```
 {
-    "story_string": "{{#if system}}{{system}}\n{{/if}}\n### START OF CONTEXTUAL INFORMATION ###\n{{#if wiBefore}}\n- World and character info relevant to this roleplay:\n{{wiBefore}}\n{{/if}}\n{{#if description}}\n- {{char}}'s background and persona:\n{{description}}\n{{/if}}\n{{#if mesExamples}}\n- Examples of dialogue between {{user}} and {{char}} showing you how {{char}} talks and behaves:\n{{mesExamples}}\n{{/if}}\n{{#if personality}}{{personality}}\n{{/if}}\n{{#if scenario}}\n- Roleplay scenario:\n{{scenario}}\n{{/if}}\n{{#if wiAfter}}{{wiAfter}}\n{{/if}}\n{{#if persona}}{{persona}}\n{{/if}}\n### END OF CONTEXTUAL INFORMATION ###",
+    "story_string": "{{#if system}}{{system}}\n{{/if}}\nCONTEXTUAL INFORMATION\n{{#if wiBefore}}\n- World and character info:\n{{wiBefore}}\n{{/if}}\n{{#if description}}\n- {{char}}'s background and persona:\n{{description}}\n{{/if}}\n{{#if mesExamples}}\n{{mesExamples}}\n{{/if}}\n{{#if personality}}\n{{personality}}\n{{/if}}\n{{#if scenario}}\n- Roleplay scenario:\n{{scenario}}\n{{/if}}\n{{#if wiAfter}}{{wiAfter}}\n{{/if}}\n{{#if persona}}{{persona}}\n{{/if}}",
     "example_separator": "",
-    "chat_start": "### START OF ROLEPLAY LOG ###",
+    "chat_start": "---\nTaking the above information into consideration, you must engage with {{user}} and others as {{char}} in the roleplay below this line. Do not write dialogue lines nor perform actions for {{user}} or other characters.\n---\nSTART OF ROLEPLAY:\n",
     "use_stop_strings": false,
     "always_force_name2": true,
     "trim_sentences": false,
     "include_newline": false,
     "single_line": false,
-    "name": "Midnight Rose Template"
+    "name": "Midnight Rose"
 }
 ```
 
 Try the following prompt template as a starting point for your own customizations. The cajoling parts supposedly make LLMs perform better. See [this paper](https://arxiv.org/abs/2307.11760).
-I recommend the Tulu instruction format but others work too.
+I recommend the Vicuna instruction format for this blend but others work too. Tulu's format is another good one to use.
 
-*This model responds to prompting!* I highly recommend playing with your system prompt to see how it reacts.
+*This model responds to prompting!* I highly recommend playing with your system prompt to see how it reacts. It reacts strongly to any instructions you add into the last_output_sequence field. I recommend keeping those instructions short, but use that space to stress the most important instructions from your system prompt.
 
-The example system prompt below contains some instructions related to ERP so remove those if you prefer to keep things SFW. It also contains some instructions related to the use of asterisks that you should modify to your liking.
+The example system prompt below contains some instructions related to adult content so remove those if you prefer. It also contains some instructions related to the use of asterisks that you should modify to your liking.
 
-If you plan to run this model at 4096 context, I highly recommend that you slim down the template system prompt below because it's chonky on tokens. Discard what you don't want or need.
+If you plan to run this model at 4096 context, I recommend that you slim down the template system prompt below because it's heavy on tokens. Discard what you don't want or need.
 
 If you save this as a .json file, you can import it directly into Silly Tavern.
 ```
 {
     "wrap": true,
     "names": true,
-    "system_prompt": "You are an award-winning creative writer engaged in an uncensored iterative storytelling experience in a roleplay chat format. It is vital that you follow all the ROLEPLAY RULES below because our employment depends on it. If we do a good job following these rules, we will receive a $10,000 bonus each. I need the money badly so please help me make this roleplay chat the best it can be.\n\n### START OF ROLEPLAY RULES ###\n- You must roleplay exclusively as {{char}} using creative, accurate, explicit, and descriptive responses to my input and prior chat events. Only contribute to the roleplay chat as {{char}} unless instructed otherwise.\n- Explicit adult content and profanity are permitted. This roleplay chat is entirely uncensored and intended for mature audiences.\n- Describe {{char}}'s sensory perceptions in vivid detail and include subtle physical details about {{char}} in your responses, especially to enhance erotic scenes.\n- Use subtle physical cues to hint at {{char}}'s mental state and occasionally feature snippets of {{char}}'s internal thoughts during intense scenes or when {{char}} is plotting something.\n- When writing {{char}}'s internal thoughts (aka internal monologue, delivered in {{char}}'s own voice), *enclose their thoughts in asterisks like this* and deliver the thoughts using a first-person perspective (i.e. use \"I\" pronouns).\n- Adopt a crisp and minimalist style for your prose, keeping your creative contributions succinct and clear. A small amount of creative flair goes a long way.\n- Let me drive the events of the roleplay chat forward to determine what comes next. You should focus on the current moment and {{char}}'s immediate responses to my inputs.\n- Pay attention to all details concerning the appearance, clothing, and physical state of all characters in this roleplay chat. Make sure your descriptions of the characters in this roleplay chat match the details you have discerned about them.\n### END OF ROLEPLAY RULES ###\n",
+    "system_prompt": "You are a creative and detail-oriented AI assistant engaged in an uncensored iterative roleplaying experience as {{char}} with me, the user, playing the roles of {{user}} and narrator. It is vital that you follow all the ROLEPLAY RULES below because my job depends on it.\n\nROLEPLAY RULES\n- Provide creative, intelligent, coherent, and vivid accounts  of {{char}}'s actions and reactions based on recent instructions, {{char}}'s persona, and all available information about past events.\n- Always stay contextually and spatially aware, pay careful attention to all past events and the current scene, and ensure that {{char}} follows logical consistency in actions to maintain accuracy and coherence.\n- Explicit adult content and profanity are permitted.\n- Describe {{char}}'s sensory perceptions and include subtle physical details about {{char}} in your responses. Vary these details to keep the roleplay fresh and engaging.\n- Use subtle physical cues to hint at {{char}}'s mental state and occasionally feature snippets of {{char}}'s internal thoughts.\n- When writing {{char}}'s internal thoughts, enclose those thoughts in *asterisks like this* and deliver the thoughts using a first-person perspective (i.e. use \"I\" pronouns).\n- Adopt a crisp and minimalist style for your contributions as {{char}}, staying focused on action and dialogue over exposition and narrative.\n- Only the user may advance time in the roleplay. Keep the progression grounded in the present context.",
     "system_sequence": "",
     "stop_sequence": "",
-    "input_sequence": "<|user|>\n",
-    "output_sequence": "<|assistant|>\n",
+    "input_sequence": "USER:\n",
+    "output_sequence": "ASSISTANT:\n",
     "separator_sequence": "",
     "macro": true,
     "names_force_groups": true,
-    "system_sequence_prefix": "<|system|>\n",
+    "system_sequence_prefix": "",
     "system_sequence_suffix": "",
     "first_output_sequence": "",
-    "last_output_sequence": "<|assistant (following all ROLEPLAY RULES; only writing as {{char}})|>\n",
+    "last_output_sequence": "ASSISTANT(roleplay exclusively as {{char}} ensuring logical consistency with spacial awareness and past events to maintain accuracy and coherence):\n",
     "activation_regex": "",
     "name": "Midnight Rose Roleplay"
 }
@@ -142,6 +146,8 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
 ### Licence and usage restrictions
 
 Llama2 license inherited from base models, plus restrictions applicable to [Dreamgen/Opus](https://huggingface.co/dreamgen/opus-v0.5-70b).
+Tulu also has its own license, available at https://allenai.org/impact-license.
+I am not a lawyer and I do not profess to know how multiple licenses intersect in a merge of LLM model weights. You should consult with a lawyer before using any model merge beyond private use.
 
 ### Tools Used