sphiratrioth666
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -35,14 +35,28 @@ All the other samplers neutralized. That's all you need in modern times (2024/20
|
|
35 |
**Advanced Users:** Enjoy, modify, forget.\
|
36 |
**Beginner Users:** Read further.
|
37 |
|
38 |
-
1. Find your
|
39 |
-
***<<<
|
40 |
2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
|
41 |
-
***<<<
|
42 |
3. Download my presets.
|
43 |
-
4. Copy the [CONTEXT TEMPLATE] files to (...)\SillyTavern\data\default-user\context
|
44 |
-
5. Copy the [INSTRUCT TEMPLATE] files to (...)\SillyTavern\data\default-user\context
|
45 |
-
6. Copy the [SETTINGS] files to SillyTavern\data\default-user\TextGen Settings
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
46 |
|
47 |
*Context Template = Story String*
|
48 |
People often get confused with names.
|
|
|
35 |
**Advanced Users:** Enjoy, modify, forget.\
|
36 |
**Beginner Users:** Read further.
|
37 |
|
38 |
+
1. Find your model's native INSTRUCT TEMPLATE. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting the first fine-tune of Mistral Small" or "Nemo on steroids" or "LLAMA 3 with our special sauce" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work best. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
|
39 |
+
***<<< Most typical templates: Mistral, ChatML, Alpaca, Metharme/Pygmalion >>>***
|
40 |
2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
|
41 |
+
***<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>***/
|
42 |
3. Download my presets.
|
43 |
+
4. Copy the [Sphiratrioth-(...)-CONTEXT TEMPLATE] files to (...)\SillyTavern\data\default-user\context.
|
44 |
+
5. Copy the [Sphiratrioth-(...)-INSTRUCT TEMPLATE] files to (...)\SillyTavern\data\default-user\context.
|
45 |
+
6. Copy the [Sphiratrioth-(...)-SETTINGS] files to SillyTavern\data\default-user\TextGen Settings.
|
46 |
+
7. Copy the [Sphiratrioth-(...)-PROMPT] files to (...)\SillyTavern\data\default-user\sysprompt.
|
47 |
+
8. Open up Silly Tavern UI.
|
48 |
+
9. Click on the "Capital A" tab in Silly Tavern UI (AI Response Formatting).
|
49 |
+
10. Load up my Context Template (Story String) Preset from the Context Templates list.
|
50 |
+
11. Load up my Instruct Template Preset from the Instruct Templates list.
|
51 |
+
12. Load up my System Prompt from the System Prompts list.
|
52 |
+
13. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
|
53 |
+
14. Load up my Settings Preset from the Text Completion Presets list.
|
54 |
+
15. Enjoy.
|
55 |
+
<br>
|
56 |
+
<h1>BEWARE:</h1>
|
57 |
+
|
58 |
+
**IF YOU WANT THE PRESETS TO WORK PROPERLY, REMEMBER TO START A NEW CHAT FOR TESTING PURPOSES/ACTUAL ROLE-PLAY. WHEN YOU SWITCH THE PRESETS "HOT", YOU MAY EASILY FALL INTO A TRAP OF CONTINUING THE PREVIOUS PROMPT. IN RESULT, THE SHORT/BALANCED/LONG RESPONSES AND NARRATION IN 1st/3rd PERSON WILL NOT SWITCH. ALWAYS START A NEW CHAT. THEORETICALLY, SWITCHING A SYSTEM PROMPT FORCES THE PROMPT EVALUATION BUT IN REALITY - IT OFTEN BREAKS, IT DOES NOT WORK PROPERLY. IT WORKS WHEN YOU START A NEW CHAT THOUGH - OR WHEN YOU RELOAD THE WHOLE SILLY TAVERN UI.**
|
59 |
+
|
60 |
|
61 |
*Context Template = Story String*
|
62 |
People often get confused with names.
|