sphiratrioth666 commited on
Commit
9f740ab
·
verified ·
1 Parent(s): 7f5a5ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -6
README.md CHANGED
@@ -35,14 +35,28 @@ All the other samplers neutralized. That's all you need in modern times (2024/20
35
  **Advanced Users:** Enjoy, modify, forget.\
36
  **Beginner Users:** Read further.
37
 
38
- 1. Find your LLM (model) native instruct template. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting a fine-tune of Mistral Small" or "Nemo on steroids" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work better. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
39
- ***<<< most typical templates: Mistral, ChatML, Alpaca, Metharme/Pygmalion >>>***
40
  2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
41
- ***<<< this rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true, Tolkien's Lord of the Templates.>>>***/
42
  3. Download my presets.
43
- 4. Copy the [CONTEXT TEMPLATE] files to (...)\SillyTavern\data\default-user\context
44
- 5. Copy the [INSTRUCT TEMPLATE] files to (...)\SillyTavern\data\default-user\context
45
- 6. Copy the [SETTINGS] files to SillyTavern\data\default-user\TextGen Settings
 
 
 
 
 
 
 
 
 
 
 
 
 
 
46
 
47
  *Context Template = Story String*
48
  People often get confused with names.
 
35
  **Advanced Users:** Enjoy, modify, forget.\
36
  **Beginner Users:** Read further.
37
 
38
+ 1. Find your model's native INSTRUCT TEMPLATE. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting the first fine-tune of Mistral Small" or "Nemo on steroids" or "LLAMA 3 with our special sauce" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work best. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
39
+ ***<<< Most typical templates: Mistral, ChatML, Alpaca, Metharme/Pygmalion >>>***
40
  2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
41
+ ***<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>***/
42
  3. Download my presets.
43
+ 4. Copy the [Sphiratrioth-(...)-CONTEXT TEMPLATE] files to (...)\SillyTavern\data\default-user\context.
44
+ 5. Copy the [Sphiratrioth-(...)-INSTRUCT TEMPLATE] files to (...)\SillyTavern\data\default-user\context.
45
+ 6. Copy the [Sphiratrioth-(...)-SETTINGS] files to SillyTavern\data\default-user\TextGen Settings.
46
+ 7. Copy the [Sphiratrioth-(...)-PROMPT] files to (...)\SillyTavern\data\default-user\sysprompt.
47
+ 8. Open up Silly Tavern UI.
48
+ 9. Click on the "Capital A" tab in Silly Tavern UI (AI Response Formatting).
49
+ 10. Load up my Context Template (Story String) Preset from the Context Templates list.
50
+ 11. Load up my Instruct Template Preset from the Instruct Templates list.
51
+ 12. Load up my System Prompt from the System Prompts list.
52
+ 13. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
53
+ 14. Load up my Settings Preset from the Text Completion Presets list.
54
+ 15. Enjoy.
55
+ <br>
56
+ <h1>BEWARE:</h1>
57
+
58
+ **IF YOU WANT THE PRESETS TO WORK PROPERLY, REMEMBER TO START A NEW CHAT FOR TESTING PURPOSES/ACTUAL ROLE-PLAY. WHEN YOU SWITCH THE PRESETS "HOT", YOU MAY EASILY FALL INTO A TRAP OF CONTINUING THE PREVIOUS PROMPT. IN RESULT, THE SHORT/BALANCED/LONG RESPONSES AND NARRATION IN 1st/3rd PERSON WILL NOT SWITCH. ALWAYS START A NEW CHAT. THEORETICALLY, SWITCHING A SYSTEM PROMPT FORCES THE PROMPT EVALUATION BUT IN REALITY - IT OFTEN BREAKS, IT DOES NOT WORK PROPERLY. IT WORKS WHEN YOU START A NEW CHAT THOUGH - OR WHEN YOU RELOAD THE WHOLE SILLY TAVERN UI.**
59
+
60
 
61
  *Context Template = Story String*
62
  People often get confused with names.