Update README.md
Browse files
README.md
CHANGED
@@ -97,12 +97,13 @@ your desired response length:
|
|
97 |
![settings](https://files.catbox.moe/6lcz0u.png)
|
98 |
|
99 |
## Text generation settings
|
100 |
-
|
101 |
-
|
102 |
|
103 |
- TFS = 0.90~0.95
|
104 |
-
- Temperature = 0.
|
105 |
-
- Repetition penalty =
|
|
|
106 |
- top-k = 0 (disabled)
|
107 |
- top-p = 1 (disabled)
|
108 |
|
|
|
97 |
![settings](https://files.catbox.moe/6lcz0u.png)
|
98 |
|
99 |
## Text generation settings
|
100 |
+
Mistral-7B-v0.1 appears to have repetition issues. A low temperature combined with a relatively high
|
101 |
+
repetition penalty and low penalty range (about as long as the prior 2 messages) appears to help:
|
102 |
|
103 |
- TFS = 0.90~0.95
|
104 |
+
- Temperature = 0.50~0.55
|
105 |
+
- Repetition penalty = ~1.15
|
106 |
+
- Repetition penalty range = ~512
|
107 |
- top-k = 0 (disabled)
|
108 |
- top-p = 1 (disabled)
|
109 |
|