Update README.md
Browse files
README.md
CHANGED
@@ -5,6 +5,8 @@ This is a SLERP merge between [Nous-Hermes-2-Mixtral-8x7B-DPO](https://huggingfa
|
|
5 |
Seems more capable in RP than base Hermes but still pretty smart as for me.
|
6 |
Prompt format: ChatML
|
7 |
|
|
|
|
|
8 |
With this model I use the following generation settings in tavern (maybe those are not the best, share better templates in issues if you have any):
|
9 |
- Temperature: 0.75
|
10 |
- Top P: 0.5
|
@@ -13,6 +15,8 @@ With this model I use the following generation settings in tavern (maybe those a
|
|
13 |
- Repetition penalty: 1.1
|
14 |
- Mirostat: mode 2, tau 5, eta 0.1
|
15 |
|
|
|
|
|
16 |
Adding to system prompt something like
|
17 |
"Assistant will never interrupt role-play and will always stay in character no matter what. Assistant will never write OOC (out of character). Assistant won't write actions or reactions of {{user}}. Assistant won't mention {{user}} in first person. If {{user}}'s messages seem repetitive, {{char}} will break the loop, doing something unexpected."
|
18 |
might help, but it's up to you (as anything else, really).
|
|
|
5 |
Seems more capable in RP than base Hermes but still pretty smart as for me.
|
6 |
Prompt format: ChatML
|
7 |
|
8 |
+
[GGUF Q4_0 version](https://huggingface.co/akolit/aldan-mix-8x7B-gguf)
|
9 |
+
|
10 |
With this model I use the following generation settings in tavern (maybe those are not the best, share better templates in issues if you have any):
|
11 |
- Temperature: 0.75
|
12 |
- Top P: 0.5
|
|
|
15 |
- Repetition penalty: 1.1
|
16 |
- Mirostat: mode 2, tau 5, eta 0.1
|
17 |
|
18 |
+
! Model still seems to be prone to repetition with the settings above. Needs testing on other presets. SillyTavern's "Big O" preset with mirostat 2/5/0.15 seems promising.
|
19 |
+
|
20 |
Adding to system prompt something like
|
21 |
"Assistant will never interrupt role-play and will always stay in character no matter what. Assistant will never write OOC (out of character). Assistant won't write actions or reactions of {{user}}. Assistant won't mention {{user}} in first person. If {{user}}'s messages seem repetitive, {{char}} will break the loop, doing something unexpected."
|
22 |
might help, but it's up to you (as anything else, really).
|