disinfozone commited on
Commit
0d32af7
1 Parent(s): 702d501

added alt parameter settings

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -45,12 +45,20 @@ For optimal performance, `Disinfo4_mistral-ft-optimized-1218` should be utilized
45
  ### Mirostat Parameters
46
 
47
  - **Temperature (Temp):** 1
48
- - **Top-p (top_p):** 1
49
  - **Mirostat Tau:** 7.19
50
  - **Mirostat Eta:** 0.01
51
  - **Mirostat Mode:** 2
52
  - **Others:** Default or disabled
53
 
 
 
 
 
 
 
 
 
 
54
  ## Additional Configuration
55
 
56
  This model uses the default Mistral 8k/32k context window.
 
45
  ### Mirostat Parameters
46
 
47
  - **Temperature (Temp):** 1
 
48
  - **Mirostat Tau:** 7.19
49
  - **Mirostat Eta:** 0.01
50
  - **Mirostat Mode:** 2
51
  - **Others:** Default or disabled
52
 
53
+ This model works best with mirostat! If you don't have that option, the below settings are sort of as creative, though they are also more prone to errors:
54
+ - **Temp:** 4
55
+ - **Top K:** 40
56
+ - **Repeat Penalty:** 1.1
57
+ - **Min P:** 0.001 (0.01 if your app doesn't allow lower)
58
+ - **Top P:** disabled (top P absolutely lobotomizes language though it improves accuracy etc.)
59
+
60
+ This model *loves* to hallucinate books, quotes, etc but what do you expect from the disinfo.zone?
61
+
62
  ## Additional Configuration
63
 
64
  This model uses the default Mistral 8k/32k context window.