lemonilia commited on
Commit
a5dec36
1 Parent(s): f688837

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -97,12 +97,13 @@ your desired response length:
97
  ![settings](https://files.catbox.moe/6lcz0u.png)
98
 
99
  ## Text generation settings
100
- Extensive testing with Mistral has not been performed yet, but suggested starting text
101
- generation settings may be:
102
 
103
  - TFS = 0.90~0.95
104
- - Temperature = 0.70~0.85
105
- - Repetition penalty = 1.08~1.10
 
106
  - top-k = 0 (disabled)
107
  - top-p = 1 (disabled)
108
 
 
97
  ![settings](https://files.catbox.moe/6lcz0u.png)
98
 
99
  ## Text generation settings
100
+ Mistral-7B-v0.1 appears to have repetition issues. A low temperature combined with a relatively high
101
+ repetition penalty and low penalty range (about as long as the prior 2 messages) appears to help:
102
 
103
  - TFS = 0.90~0.95
104
+ - Temperature = 0.50~0.55
105
+ - Repetition penalty = ~1.15
106
+ - Repetition penalty range = ~512
107
  - top-k = 0 (disabled)
108
  - top-p = 1 (disabled)
109