|
--- |
|
tags: |
|
- roleplay |
|
--- |
|
|
|
> [!WARNING] |
|
> **More work to be done with samplers, both of the included samplers break formatting. :|**<br> |
|
> **If you run into issues becuase of the guidelines being sent in the last assistnat pre-fix, try doing [this](https://huggingface.co/Virt-io/SillyTavern-Presets/discussions/1#6634224230c0652a8ae23dfd).** |
|
|
|
> [!IMPORTANT] |
|
> **Turn on trim if you like it I just suffer from FOMO.**<br> |
|
|
|
Thanks to [shrinkedd](https://www.reddit.com/r/SillyTavernAI/comments/1ca4xo8/ive_thought_of_a_way_to_decrease_chances_of/) for some ideas. |
|
|
|
### SillyTavern Presets |
|
|
|
# Usage |
|
|
|
Make sure to grab both context and instruct templates. |
|
It should look something like this. |
|
|
|
<img src="https://huggingface.co/Virt-io/SillyTavern-Presets/resolve/main/Images/Silly_Tavern_preset.png"> |
|
|
|
When using these presets you must set **Example Messages Behavior: Never include examples** otherwise they will be sent twice. |
|
|
|
<img src="https://huggingface.co/Virt-io/SillyTavern-Presets/resolve/main/Images/ExampleMessages.png"> |
|
|
|
The reason for this, is because I explicitly set for them to be sent. The default behavior is for them to just be added at the end of the context prompt. |
|
|
|
|
|
# Samplers |
|
|
|
**I have decided to remove old samplers and only keep basic presets, I want people to play around and find what works best for them. Change context to desired context length** |
|
|
|
**[Dynamic-Temp]Roleplay has a tendency to break asterisk formatting, however is also stops alot of the GPTism.** |
|
|
|
[SillyTavern Docs](https://docs.sillytavern.app/usage/common-settings/#sampler-parameters) |
|
|
|
**Temperature** |
|
Feel free to play with this one, lower values are more grounded. |
|
|
|
**Min-P** |
|
Higher values chop off more probabilities. |
|
|
|
|
|
Values between 0.025 - 0.10 are good, personally I would use 0.075 or lower. |
|
|
|
**Repetition Penalty** |
|
Tries to decrease repetition. |
|
|
|
|
|
Do not set it higher than 1.2. |
|
|
|
|
|
1.05 - 1.15 seem to work fine. |
|
|
|
**Rep Pen Range** |
|
The range of tokens which Repetition Penalty can see. |
|
I have it set to 2048. |
|
|
|
**Frequency Penalty** |
|
Decreases repetition. |
|
|
|
**Presence Penalty** |
|
Increases word variety. |
|
|
|
**Dynamic Temperature** |
|
Min and Max temps, free to change as desired. |
|
|
|
|
|
Exponent, do not set Exponent higher than the default of 1. |
|
|
|
|
|
You might want to try playing around and setting it lower than 1, this pushes lower probabilies higher. |
|
|
|
|
|
When setting exponent lower than 1, set Min-P a little higher (0.075) |
|
|
|
**Smooth Sampling** |
|
This one is great, smoothens out probabilities. |
|
|
|
|
|
Lower is more diverse. |
|
|
|
|
|
Recommended range 0.1 - 0.3 |
|
|
|
|
|
# Character Cards |
|
|
|
**The following is just personal preference.** |
|
|
|
<img src="https://huggingface.co/Virt-io/SillyTavern-Presets/resolve/main/Images/Character_Cards_01.png"> |
|
|
|
|
|
> [!IMPORTANT] |
|
> **Switch to my Assistant presets**<br> |
|
> **Create a new neutral persona(USER_01)**<br> |
|
> **I am currently running https://github.com/gaffe-buck/tavern-v2-character-creator inside a container** |
|
|
|
|
|
**Choosing a mode** |
|
|
|
Prepend one of the following, before your request. |
|
|
|
``` |
|
> Text Editor |
|
|
|
> Character Creator |
|
|
|
> Flexible P-list Formatter |
|
|
|
> Ali-chat Generator |
|
|
|
> Opening Scenario Writer |
|
``` |
|
|
|
Example: |
|
``` |
|
> Text Editor |
|
|
|
--- |
|
|
|
Re-write the scenario in a dark fantasy philosophical style. |
|
``` |
|
|
|
<img src="https://huggingface.co/Virt-io/SillyTavern-Presets/resolve/main/Images/Character_Cards_02.png"> |
|
|